2021-03-30T04:52:20.283 INFO:root:teuthology version: 1.1.0-9870012c 2021-03-30T04:52:20.285 DEBUG:teuthology.run:Teuthology command: teuthology --name sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi --archive /home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011047 --owner scheduled_sage@teuthology --verbose --description rados/standalone/{supported-random-distro$/{rhel_latest} workloads/misc} -- /home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011047/orig.config.yaml 2021-03-30T04:52:20.314 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-30T04:52:20.362 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011047 branch: wip-sage4-testing-2021-03-29-2018-octopus description: rados/standalone/{supported-random-distro$/{rhel_latest} workloads/misc} email: null first_in_suite: false job_id: '6011047' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.2' overrides: admin_socket: branch: wip-sage4-testing-2021-03-29-2018-octopus ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: e4949d651265114d7b464cd1e8986d9a31a26071 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: e4949d651265114d7b464cd1e8986d9a31a26071 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-sage4-testing-2021-03-29-2018-octopus sha1: e4949d651265114d7b464cd1e8986d9a31a26071 owner: scheduled_sage@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: e4949d651265114d7b464cd1e8986d9a31a26071 sleep_before_teardown: 0 suite: rados suite_branch: wip-sage4-testing-2021-03-29-2018-octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e4949d651265114d7b464cd1e8986d9a31a26071/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: e4949d651265114d7b464cd1e8986d9a31a26071 targets: smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCvdviYdf/Q8tIIWQidyn6Zl6GeWlG1F7WPe3TWWLSOuPB4ntDZlsSVVwKuodmfaeSxl7lE+S9p41thDt2KuDuHlv4j+9Cj3KFG2rzrh0i70tSki5bdA3gypWv7fvrfsUNlMT19ljI1v64IMSlEJMz4+3Q2UYE74dAk1gDigHNyDnaIul0nrMy5AgYAFSBtJLNKoLJFd0rY1IXUPO22BK40xzNVhIrmV3NJYdkqHP+NKyhp7oIA0qXa3uf5QTY4izckFiMcwROZJ0pP3tHggpcu0U0RZgKcL5ctzqML2tUr4LMf1g2FEYxGX40Qqnuz3pg5sDlnqDJY3B3Zqi144DhjUKR0KiqEtSyJi9a4mUSezwSDvgFPML+bi9CtcGSGt6SqIkgm1qyisV4GfnOEPK7RuPcBb1h1XWAU2FdX/dpMyRL6Tdwxib/dCZdL6BtJl4DYCrV+gmmh8rvkUOedxk7QzCfJnQHz+cWFRo27Qd2Od0v+lKhQlVBZu+7Up7sWd8= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - misc teuthology_branch: master teuthology_sha1: 9870012c9b43ad9e4e27984868ce0706e230f04f timestamp: 2021-03-30_02:52:08 tube: smithi user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.16628 2021-03-30T04:52:20.363 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e4949d651265114d7b464cd1e8986d9a31a26071/qa; will attempt to use it 2021-03-30T04:52:20.364 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e4949d651265114d7b464cd1e8986d9a31a26071/qa/tasks 2021-03-30T04:52:20.364 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-30T04:52:20.366 INFO:teuthology.task.internal:Checking packages... 2021-03-30T04:52:20.403 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'e4949d651265114d7b464cd1e8986d9a31a26071' 2021-03-30T04:52:20.404 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-30T04:52:20.404 INFO:teuthology.packaging:ref: None 2021-03-30T04:52:20.404 INFO:teuthology.packaging:tag: None 2021-03-30T04:52:20.405 INFO:teuthology.packaging:branch: wip-sage4-testing-2021-03-29-2018-octopus 2021-03-30T04:52:20.405 INFO:teuthology.packaging:sha1: e4949d651265114d7b464cd1e8986d9a31a26071 2021-03-30T04:52:20.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-sage4-testing-2021-03-29-2018-octopus 2021-03-30T04:52:20.541 INFO:teuthology.task.internal:Found packages for ceph version 15.2.10-14.ge4949d65 2021-03-30T04:52:20.542 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-30T04:52:20.552 INFO:teuthology.task.internal:no buildpackages task found 2021-03-30T04:52:20.553 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-30T04:52:20.611 INFO:teuthology.task.internal:Saving configuration 2021-03-30T04:52:20.621 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-30T04:52:20.655 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-30T04:52:20.674 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-30 04:47:25.781755', 'description': '/home/teuthworker/archive/sage-2021-03-30_02:52:08-rados-wip-sage4-testing-2021-03-29-2018-octopus-distro-basic-smithi/6011047', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOT7+Ay2WYuC5JYIYp7lSZ+mu6ZqO3zr1OBHqrjNRTIoS6Cuwqb+0PZrBpynSwWC1S4lwcbLelqDjiHLo0DWslc=', 'os_version': '8.2', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi197.front.sepia.ceph.com'} 2021-03-30T04:52:20.675 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-30T04:52:20.705 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2021-03-30T04:52:20.706 INFO:teuthology.run_tasks:Running task console_log... 2021-03-30T04:52:20.797 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0da8bcdf28>, signals=[15]) 2021-03-30T04:52:20.798 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-30T04:52:20.830 INFO:teuthology.task.internal:Opening connections... 2021-03-30T04:52:20.830 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi197.front.sepia.ceph.com 2021-03-30T04:52:20.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T04:52:20.902 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-30T04:52:20.912 DEBUG:teuthology.orchestra.run.smithi197:> uname -m 2021-03-30T04:52:21.070 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2021-03-30T04:52:21.070 DEBUG:teuthology.orchestra.run.smithi197:> cat /etc/os-release 2021-03-30T04:52:21.125 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="Red Hat Enterprise Linux" 2021-03-30T04:52:21.125 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8.2 (Ootpa)" 2021-03-30T04:52:21.126 INFO:teuthology.orchestra.run.smithi197.stdout:ID="rhel" 2021-03-30T04:52:21.126 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="fedora" 2021-03-30T04:52:21.126 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8.2" 2021-03-30T04:52:21.127 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8" 2021-03-30T04:52:21.127 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.2 (Ootpa)" 2021-03-30T04:52:21.128 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31" 2021-03-30T04:52:21.128 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.2:GA" 2021-03-30T04:52:21.129 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.redhat.com/" 2021-03-30T04:52:21.129 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-30T04:52:21.130 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:52:21.130 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-03-30T04:52:21.130 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.2 2021-03-30T04:52:21.131 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-30T04:52:21.131 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.2" 2021-03-30T04:52:21.133 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2021-03-30T04:52:21.151 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-30T04:52:21.164 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-30T04:52:21.264 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-30T04:52:21.265 DEBUG:teuthology.orchestra.run.smithi197:> test '!' -e /home/ubuntu/cephtest 2021-03-30T04:52:21.278 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-30T04:52:21.306 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-30T04:52:21.306 DEBUG:teuthology.orchestra.run.smithi197:> test -z $(ls -A /var/lib/ceph) 2021-03-30T04:52:21.341 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-30T04:52:21.371 INFO:teuthology.run_tasks:Running task kernel... 2021-03-30T04:52:21.416 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2021-03-30T04:52:21.417 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-30T04:52:21.418 DEBUG:teuthology.orchestra.run.smithi197:> uname -r 2021-03-30T04:52:21.436 INFO:teuthology.orchestra.run.smithi197.stdout:4.18.0-240.15.1.el8_3.x86_64 2021-03-30T04:52:21.437 INFO:teuthology.task.kernel:Running kernel on smithi197: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T04:52:21.437 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum install -y kernel 2021-03-30T04:52:23.276 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:52:23.277 INFO:teuthology.orchestra.run.smithi197.stdout:Unable to read consumer identity 2021-03-30T04:52:23.394 INFO:teuthology.orchestra.run.smithi197.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-30T04:52:25.495 INFO:teuthology.orchestra.run.smithi197.stdout:Extra Packages for Enterprise Linux 16 MB/s | 9.1 MB 00:00 2021-03-30T04:52:27.339 INFO:teuthology.orchestra.run.smithi197.stdout:lab-extras 4.0 MB/s | 24 kB 00:00 2021-03-30T04:52:27.953 INFO:teuthology.orchestra.run.smithi197.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-03-30T04:52:27.954 INFO:teuthology.orchestra.run.smithi197.stdout:Package kernel-4.18.0-240.15.1.el8_3.x86_64 is already installed. 2021-03-30T04:52:28.074 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:52:28.082 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T04:52:28.083 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:52:28.207 DEBUG:teuthology.orchestra.run.smithi197:> echo no | sudo yum reinstall kernel || true 2021-03-30T04:52:28.538 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:52:28.539 INFO:teuthology.orchestra.run.smithi197.stdout:Unable to read consumer identity 2021-03-30T04:52:28.591 INFO:teuthology.orchestra.run.smithi197.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-30T04:52:28.767 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:00:01 ago on Tue 30 Mar 2021 04:52:27 AM UTC. 2021-03-30T04:52:28.883 INFO:teuthology.orchestra.run.smithi197.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from anaconda) not available. 2021-03-30T04:52:28.884 INFO:teuthology.orchestra.run.smithi197.stdout:Installed package kernel-4.18.0-240.15.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-03-30T04:52:28.916 INFO:teuthology.orchestra.run.smithi197.stderr:Error: No packages marked for reinstall. 2021-03-30T04:52:28.960 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum reinstall -y kernel || true 2021-03-30T04:52:29.291 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:52:29.292 INFO:teuthology.orchestra.run.smithi197.stdout:Unable to read consumer identity 2021-03-30T04:52:29.336 INFO:teuthology.orchestra.run.smithi197.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-03-30T04:52:29.513 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:00:02 ago on Tue 30 Mar 2021 04:52:27 AM UTC. 2021-03-30T04:52:29.631 INFO:teuthology.orchestra.run.smithi197.stdout:Installed package kernel-4.18.0-193.el8.x86_64 (from anaconda) not available. 2021-03-30T04:52:29.632 INFO:teuthology.orchestra.run.smithi197.stdout:Installed package kernel-4.18.0-240.15.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-03-30T04:52:29.655 INFO:teuthology.orchestra.run.smithi197.stderr:Error: No packages marked for reinstall. 2021-03-30T04:52:29.698 DEBUG:teuthology.orchestra.run.smithi197:> rpm -q kernel --last | head -n 1 2021-03-30T04:52:29.776 INFO:teuthology.orchestra.run.smithi197.stdout:kernel-4.18.0-240.15.1.el8_3.x86_64 Sun 28 Feb 2021 12:11:44 PM UTC 2021-03-30T04:52:29.777 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.15.1.el8_3.x86_64 2021-03-30T04:52:29.778 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-30T04:52:29.778 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-30T04:52:29.778 DEBUG:teuthology.orchestra.run.smithi197:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-30T04:52:29.840 INFO:teuthology.orchestra.run.smithi197.stdout:ttyS1 2021-03-30T04:52:29.855 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-30T04:52:29.863 INFO:teuthology.task.internal:Creating test directory... 2021-03-30T04:52:29.864 DEBUG:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-30T04:52:29.878 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-30T04:52:29.932 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-30T04:52:29.991 INFO:teuthology.task.internal:Creating archive directory... 2021-03-30T04:52:29.992 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-30T04:52:30.016 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-30T04:52:30.049 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-30T04:52:30.050 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-30T04:52:30.086 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T04:52:30.096 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T04:52:30.098 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-30T04:52:30.119 INFO:teuthology.task.internal:Configuring sudo... 2021-03-30T04:52:30.120 DEBUG:teuthology.orchestra.run.smithi197:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-30T04:52:30.164 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-30T04:52:30.184 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-30T04:52:30.185 DEBUG:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-30T04:52:30.218 DEBUG:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-30T04:52:30.294 DEBUG:teuthology.orchestra.run.smithi197:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-30T04:52:30.356 DEBUG:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-30T04:52:30.431 DEBUG:teuthology.orchestra.run.smithi197:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-30T04:52:30.476 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-03-30T04:52:30.477 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-30T04:52:30.540 DEBUG:teuthology.orchestra.run.smithi197:> sudo service rsyslog restart 2021-03-30T04:52:30.665 INFO:teuthology.orchestra.run.smithi197.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-03-30T04:52:30.931 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-30T04:52:30.942 INFO:teuthology.task.internal:Starting timer... 2021-03-30T04:52:30.943 INFO:teuthology.run_tasks:Running task pcp... 2021-03-30T04:52:31.001 INFO:teuthology.run_tasks:Running task selinux... 2021-03-30T04:52:31.058 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-03-30T04:52:31.058 DEBUG:teuthology.orchestra.run.smithi197:> sudo service auditd rotate 2021-03-30T04:52:31.144 INFO:teuthology.orchestra.run.smithi197.stdout:Rotating logs: [ OK ] 2021-03-30T04:52:31.146 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-30T04:52:31.146 DEBUG:teuthology.orchestra.run.smithi197:> /usr/sbin/getenforce 2021-03-30T04:52:31.166 INFO:teuthology.orchestra.run.smithi197.stdout:Permissive 2021-03-30T04:52:31.167 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi197.front.sepia.ceph.com': 'permissive'} 2021-03-30T04:52:31.167 DEBUG:teuthology.orchestra.run.smithi197:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-03-30T04:52:31.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-30T04:52:31.232 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-30T04:52:31.232 DEBUG:teuthology.orchestra.run.smithi197:> sudo /usr/sbin/setenforce permissive 2021-03-30T04:52:31.297 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-30T04:52:31.311 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-30T04:52:31.312 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-30T04:52:31.328 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-30T04:52:31.330 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi197.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-30T04:52:31.704 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-30T04:52:32.541 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-30T04:52:34.625 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-30T04:52:34.647 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:34 +0000 (0:00:00.038) 0:00:00.038 ********* 2021-03-30T04:52:36.107 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-30T04:52:36.109 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] 2021-03-30T04:52:36.158 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:36 +0000 (0:00:01.511) 0:00:01.549 ********* 2021-03-30T04:52:36.499 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-30T04:52:36.501 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-03-30T04:52:36.522 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:36 +0000 (0:00:00.363) 0:00:01.913 ********* 2021-03-30T04:52:37.120 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi197.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-30T04:52:37.143 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:37 +0000 (0:00:00.620) 0:00:02.533 ********* 2021-03-30T04:52:37.224 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-30T04:52:37.225 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:52:37.255 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:37 +0000 (0:00:00.112) 0:00:02.646 ********* 2021-03-30T04:52:37.635 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-30T04:52:37.637 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-30T04:52:37.657 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:37 +0000 (0:00:00.401) 0:00:03.047 ********* 2021-03-30T04:52:38.662 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617079957.7001426-8926-261863977617518/source", "state": "file", "uid": 0} 2021-03-30T04:52:38.685 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:38 +0000 (0:00:01.028) 0:00:04.076 ********* 2021-03-30T04:52:39.386 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-30T04:52:39.387 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-03-30T04:52:39.389 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-30T04:52:39.451 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-30T04:52:39.454 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-30T04:52:39.644 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:39 +0000 (0:00:00.959) 0:00:05.035 ********* 2021-03-30T04:52:40.284 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi197.front.sepia.ceph.com] 2021-03-30T04:52:40.333 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-30T04:52:40.335 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:40 +0000 (0:00:00.688) 0:00:05.724 ********* 2021-03-30T04:52:41.000 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-30T04:52:41.002 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.197232", "end": "2021-03-30 04:52:40.970539", "rc": 0, "start": "2021-03-30 04:52:40.773307", "stderr": "", "stderr_lines": [], "stdout": "e40da710ee70e6a48fb6fff946fd52335ac80ce5", "stdout_lines": ["e40da710ee70e6a48fb6fff946fd52335ac80ce5"]} 2021-03-30T04:52:41.021 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.687) 0:00:06.412 ********* 2021-03-30T04:52:41.223 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-30T04:52:41.225 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.019386", "end": "2021-03-30 04:52:41.205818", "failed_when_result": false, "rc": 0, "start": "2021-03-30 04:52:41.186432", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-30T04:52:41.247 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.226) 0:00:06.638 ********* 2021-03-30T04:52:41.337 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-30T04:52:41.339 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:52:41.360 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.112) 0:00:06.751 ********* 2021-03-30T04:52:41.450 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:52:41.472 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.111) 0:00:06.863 ********* 2021-03-30T04:52:41.540 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-30T04:52:41.542 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:52:41.562 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.089) 0:00:06.952 ********* 2021-03-30T04:52:41.629 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-30T04:52:41.632 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:52:41.650 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.088) 0:00:07.041 ********* 2021-03-30T04:52:41.717 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-30T04:52:41.719 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:52:41.740 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.089) 0:00:07.131 ********* 2021-03-30T04:52:41.973 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-30T04:52:41.975 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-30T04:52:41.995 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:52:41 +0000 (0:00:00.254) 0:00:07.386 ********* 2021-03-30T04:52:42.290 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-30T04:52:42.292 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-30T04:52:42.489 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-30T04:52:42.687 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-30T04:52:42.896 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-30T04:52:43.104 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-30T04:52:43.301 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-30T04:52:43.509 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-30T04:52:43.707 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-30T04:52:43.906 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-30T04:52:44.107 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-30T04:52:44.315 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-30T04:52:44.524 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-30T04:52:44.735 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-30T04:52:44.933 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-30T04:52:45.139 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-30T04:52:45.346 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-30T04:52:45.544 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-30T04:52:45.743 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-30T04:52:45.944 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-30T04:52:46.154 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-30T04:52:46.363 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-30T04:52:46.581 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-30T04:52:46.780 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-30T04:52:46.989 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-30T04:52:47.187 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-30T04:52:47.397 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-30T04:52:47.608 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-30T04:52:47.818 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-30T04:52:48.029 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-30T04:52:48.228 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-30T04:52:48.426 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-30T04:52:48.634 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-30T04:52:48.831 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-30T04:52:49.040 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-30T04:52:49.257 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-30T04:52:49.456 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-30T04:52:49.653 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-30T04:52:49.860 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-30T04:52:50.070 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-30T04:52:50.267 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-30T04:52:50.475 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-30T04:52:50.683 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-30T04:52:50.881 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-30T04:52:51.079 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-30T04:52:51.307 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-30T04:52:51.516 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-30T04:52:51.713 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-30T04:52:51.921 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-30T04:52:52.129 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-30T04:52:52.336 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-30T04:52:52.535 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-30T04:52:52.734 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-30T04:52:52.936 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-30T04:52:53.137 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-30T04:52:53.345 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-30T04:52:53.555 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-30T04:52:53.752 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-30T04:52:53.960 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-30T04:52:54.162 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-30T04:52:54.383 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-30T04:52:54.579 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-30T04:52:54.787 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-30T04:52:54.994 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-30T04:52:55.204 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-30T04:52:55.413 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-30T04:52:55.611 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-30T04:52:55.819 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-30T04:52:56.039 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-30T04:52:56.248 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-30T04:52:56.466 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-30T04:52:56.675 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-30T04:52:56.886 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-30T04:52:57.096 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-30T04:52:57.293 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-30T04:52:57.492 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-30T04:52:57.700 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-30T04:52:57.899 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-30T04:52:58.099 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-30T04:52:58.306 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-30T04:52:58.515 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-30T04:52:58.724 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-30T04:52:58.944 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-30T04:52:59.144 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-30T04:52:59.399 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-30T04:52:59.608 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-30T04:52:59.807 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-30T04:53:00.006 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-30T04:53:00.206 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-30T04:53:00.411 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-30T04:53:00.616 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-30T04:53:00.827 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-30T04:53:01.027 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-30T04:53:01.237 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-30T04:53:01.437 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-30T04:53:01.647 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-30T04:53:01.857 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-30T04:53:02.069 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-30T04:53:02.269 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-30T04:53:02.483 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-30T04:53:02.686 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-30T04:53:02.898 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-30T04:53:03.108 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-30T04:53:03.320 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-30T04:53:03.531 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-30T04:53:03.741 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-30T04:53:03.940 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-30T04:53:04.151 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-30T04:53:04.351 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-30T04:53:04.562 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-30T04:53:04.771 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-30T04:53:04.982 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-30T04:53:05.181 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-30T04:53:05.393 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-30T04:53:05.604 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-30T04:53:05.816 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-30T04:53:06.021 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-30T04:53:06.226 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-30T04:53:06.437 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-30T04:53:06.647 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-30T04:53:06.860 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-30T04:53:07.061 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-30T04:53:07.265 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-30T04:53:07.490 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-30T04:53:07.691 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-30T04:53:07.892 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-30T04:53:08.102 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-30T04:53:08.305 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-30T04:53:08.518 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-30T04:53:08.711 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-30T04:53:08.912 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-30T04:53:09.124 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-30T04:53:09.342 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-30T04:53:09.546 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-30T04:53:09.757 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-30T04:53:09.967 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-30T04:53:10.176 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-30T04:53:10.379 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-30T04:53:10.587 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-30T04:53:10.795 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-30T04:53:12.312 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-03-30T04:53:12.444 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:53:12 +0000 (0:00:30.448) 0:00:37.834 ********* 2021-03-30T04:53:12.525 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-30T04:53:12.546 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:53:12 +0000 (0:00:00.102) 0:00:37.937 ********* 2021-03-30T04:53:12.649 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-30T04:53:12.651 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-03-30T04:53:12.653 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-03-30T04:53:12.655 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-03-30T04:53:12.657 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-03-30T04:53:12.659 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5 2021-03-30T04:53:12.660 INFO:teuthology.task.ansible.out:mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-30T04:53:12.662 INFO:teuthology.task.ansible.out: 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc9795 2021-03-30T04:53:12.663 INFO:teuthology.task.ansible.out:3cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e 2021-03-30T04:53:12.665 INFO:teuthology.task.ansible.out:7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef14 2021-03-30T04:53:12.667 INFO:teuthology.task.ansible.out:80c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d301 2021-03-30T04:53:12.669 INFO:teuthology.task.ansible.out:7b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88Ar 2021-03-30T04:53:12.670 INFO:teuthology.task.ansible.out:NhsAMXq/nkSC9tKDig 131b8214 2021-03-30T04:53:12.671 INFO:teuthology.task.ansible.out:bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelope 2021-03-30T04:53:12.673 INFO:teuthology.task.ansible.out:z@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed 2021-03-30T04:53:12.675 INFO:teuthology.task.ansible.out:19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}]}, "changed": false} 2021-03-30T04:53:12.697 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:53:12 +0000 (0:00:00.150) 0:00:38.087 ********* 2021-03-30T04:53:14.234 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-30T04:53:14.236 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"after": "e40da710ee70e6a48fb6fff946fd52335ac80ce5", "attempts": 1, "before": "e40da710ee70e6a48fb6fff946fd52335ac80ce5", "changed": false, "remote_url_changed": false} 2021-03-30T04:53:14.257 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:53:14 +0000 (0:00:01.560) 0:00:39.647 ********* 2021-03-30T04:53:14.695 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-30T04:53:14.979 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-30T04:53:15.271 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-30T04:53:15.553 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-03-30T04:53:15.555 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-30T04:53:15.835 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-30T04:53:16.116 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-03-30T04:53:16.118 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-30T04:53:16.399 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-30T04:53:16.667 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-30T04:53:16.955 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1s 2021-03-30T04:53:16.957 INFO:teuthology.task.ansible.out:cr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:17.233 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-03-30T04:53:17.234 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-30T04:53:17.515 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-03-30T04:53:17.516 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:17.527 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:17.798 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-30T04:53:18.090 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-03-30T04:53:18.092 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-30T04:53:18.351 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-30T04:53:18.633 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-03-30T04:53:18.636 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-30T04:53:18.913 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-30T04:53:19.201 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-30T04:53:19.481 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-30T04:53:19.759 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-03-30T04:53:19.762 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-30T04:53:20.052 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-03-30T04:53:20.054 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-30T04:53:20.325 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-30T04:53:20.608 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-30T04:53:20.904 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-03-30T04:53:20.906 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-30T04:53:21.186 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-30T04:53:21.479 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-30T04:53:21.760 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-30T04:53:22.059 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-30T04:53:22.341 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-30T04:53:22.637 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-03-30T04:53:22.639 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-30T04:53:22.924 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-30T04:53:23.219 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-30T04:53:23.504 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-30T04:53:23.799 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-30T04:53:24.090 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-30T04:53:24.369 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-30T04:53:24.656 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-30T04:53:24.933 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-30T04:53:25.229 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-30T04:53:25.534 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-03-30T04:53:25.536 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-30T04:53:25.817 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-03-30T04:53:25.819 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-30T04:53:26.104 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-30T04:53:26.401 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-30T04:53:26.689 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-30T04:53:26.999 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-03-30T04:53:27.001 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-30T04:53:27.292 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-03-30T04:53:27.294 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-03-30T04:53:27.296 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-30T04:53:27.554 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-30T04:53:27.839 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-30T04:53:28.122 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-30T04:53:28.410 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-30T04:53:28.683 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-30T04:53:28.976 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-03-30T04:53:28.978 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-30T04:53:29.250 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-30T04:53:29.632 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-30T04:53:29.943 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-03-30T04:53:29.946 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-03-30T04:53:30.244 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-30T04:53:30.535 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-30T04:53:30.832 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-03-30T04:53:30.834 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-30T04:53:31.107 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-30T04:53:31.538 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-30T04:53:31.822 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-30T04:53:32.095 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-30T04:53:32.383 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-30T04:53:32.667 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-30T04:53:32.953 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-30T04:53:33.239 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-30T04:53:33.524 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-30T04:53:33.799 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-30T04:53:34.092 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-30T04:53:34.387 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-30T04:53:34.687 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-30T04:53:34.984 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-30T04:53:35.285 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-30T04:53:35.584 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-30T04:53:35.872 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-30T04:53:36.176 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-30T04:53:36.484 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-30T04:53:36.781 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-30T04:53:37.059 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-03-30T04:53:37.061 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-30T04:53:37.357 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-30T04:53:37.662 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-30T04:53:37.935 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-30T04:53:38.219 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-30T04:53:38.504 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-03-30T04:53:38.506 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-30T04:53:38.796 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-03-30T04:53:38.798 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-30T04:53:39.071 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-30T04:53:39.361 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-30T04:53:39.663 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-30T04:53:39.949 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-30T04:53:40.234 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-30T04:53:40.517 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-30T04:53:40.800 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-30T04:53:41.094 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-03-30T04:53:41.096 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-30T04:53:41.379 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-30T04:53:41.673 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-30T04:53:41.948 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-30T04:53:42.225 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-30T04:53:42.500 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-30T04:53:42.786 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-30T04:53:43.071 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-03-30T04:53:43.075 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-30T04:53:43.355 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-30T04:53:43.650 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-30T04:53:43.935 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-30T04:53:44.218 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-30T04:53:44.504 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-30T04:53:44.789 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-30T04:53:45.075 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-30T04:53:45.357 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-30T04:53:45.644 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-30T04:53:45.931 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-30T04:53:46.205 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-30T04:53:46.483 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-30T04:53:46.779 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-30T04:53:47.052 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-30T04:53:47.359 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-30T04:53:47.642 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-30T04:53:47.915 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-30T04:53:48.201 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-30T04:53:48.494 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-03-30T04:53:48.495 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-30T04:53:48.790 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-30T04:53:49.089 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-30T04:53:49.384 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-30T04:53:49.681 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-30T04:53:49.970 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-30T04:53:50.268 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-30T04:53:50.542 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-30T04:53:50.819 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-30T04:53:51.103 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-30T04:53:51.374 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-30T04:53:51.654 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-30T04:53:51.939 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-30T04:53:52.224 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-30T04:53:52.498 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-30T04:53:52.783 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-30T04:53:53.079 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-30T04:53:53.362 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-03-30T04:53:53.364 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-30T04:53:53.649 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-30T04:53:53.944 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-03-30T04:53:54.052 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:53:54 +0000 (0:00:39.794) 0:01:19.442 ********* 2021-03-30T04:53:54.281 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-30T04:53:54.283 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.293 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.304 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.316 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.328 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.330 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.339 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.352 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.650 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-30T04:53:54.662 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.673 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:54.949 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-30T04:53:55.236 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-30T04:53:55.237 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.248 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.260 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.271 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.273 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.282 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.284 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.294 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.305 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.307 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.316 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.317 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.330 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.341 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.353 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.355 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.365 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.376 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.378 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.392 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.400 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.411 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.423 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.424 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.436 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.450 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.459 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.461 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.470 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.472 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.487 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.499 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.500 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.512 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.524 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.526 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.536 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.558 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.560 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.570 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.582 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.593 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.605 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.619 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.632 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.641 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.653 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.655 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.667 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.678 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.689 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.690 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.703 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.714 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.726 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.745 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.750 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.751 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.763 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.765 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.776 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.787 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.799 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.800 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.811 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.813 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.823 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.835 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.846 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.858 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.869 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.871 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.880 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.891 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.893 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.902 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.914 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.916 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.928 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.940 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.942 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.951 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.962 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.975 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.985 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.997 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:55.998 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.008 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.019 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.022 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.032 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.044 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.045 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.046 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.057 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.070 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.083 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.089 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.093 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.105 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.108 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.117 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.119 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.129 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.132 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.142 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.152 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.154 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.164 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.175 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.187 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.204 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.206 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.252 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:53:56 +0000 (0:00:02.201) 0:01:21.643 ********* 2021-03-30T04:53:56.456 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-03-30T04:53:56.459 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:53:56.484 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:53:56 +0000 (0:00:00.226) 0:01:21.870 ********* 2021-03-30T04:53:56.954 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi197.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-30T04:53:57.143 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-30T04:53:57.356 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-30T04:53:57.557 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-30T04:53:57.773 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-30T04:53:57.982 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-30T04:53:58.180 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-30T04:53:58.380 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-30T04:53:58.594 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-30T04:53:58.793 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-30T04:53:59.002 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-30T04:53:59.201 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-30T04:53:59.400 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-30T04:53:59.610 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-30T04:53:59.808 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-30T04:54:00.008 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-30T04:54:00.216 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-30T04:54:00.408 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-30T04:54:00.619 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-30T04:54:00.829 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-30T04:54:01.030 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-30T04:54:01.234 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-30T04:54:01.434 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-30T04:54:01.643 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-30T04:54:01.841 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-30T04:54:02.040 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-30T04:54:02.249 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-30T04:54:02.451 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-30T04:54:02.649 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-30T04:54:02.848 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-30T04:54:03.045 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-30T04:54:03.252 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-30T04:54:03.449 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-30T04:54:03.647 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-30T04:54:03.845 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-30T04:54:04.043 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-30T04:54:04.241 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-30T04:54:04.439 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-30T04:54:04.647 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-30T04:54:04.845 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-30T04:54:05.042 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-30T04:54:05.250 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-30T04:54:05.449 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-30T04:54:05.656 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-30T04:54:05.857 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-30T04:54:06.056 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-30T04:54:06.263 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-30T04:54:06.462 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-30T04:54:06.517 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:06 +0000 (0:00:10.038) 0:01:31.908 ********* 2021-03-30T04:54:07.075 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-30T04:54:07.077 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "checksum": "95f80387d2c8146af41c6fabbd5991d1959ea3bf", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "fc5159cf9aac5f65a51e3d1d20a34d9f", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617080046.6191263-17162-167720528115285/source", "state": "file", "uid": 0} 2021-03-30T04:54:07.098 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:07 +0000 (0:00:00.580) 0:01:32.489 ********* 2021-03-30T04:54:07.169 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-30T04:54:07.171 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => { "msg": "Host smithi197.front.sepia.ceph.com is running RedHat 8.2 (Ootpa)" } 2021-03-30T04:54:07.203 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:07 +0000 (0:00:00.104) 0:01:32.594 ********* 2021-03-30T04:54:07.302 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-30T04:54:07.304 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-03-30T04:54:07.327 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:07 +0000 (0:00:00.124) 0:01:32.718 ********* 2021-03-30T04:54:07.406 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:07.435 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:07 +0000 (0:00:00.107) 0:01:32.825 ********* 2021-03-30T04:54:08.041 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.340117", "end": "2021-03-30 04:54:08.012754", "rc": 0, "start": "2021-03-30 04:54:07.672637", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-30T04:54:08.067 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.631) 0:01:33.457 ********* 2021-03-30T04:54:08.167 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-30T04:54:08.169 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:08.193 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.126) 0:01:33.583 ********* 2021-03-30T04:54:08.283 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-30T04:54:08.285 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:08.307 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.114) 0:01:33.698 ********* 2021-03-30T04:54:08.409 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-30T04:54:08.411 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:08.431 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.123) 0:01:33.822 ********* 2021-03-30T04:54:08.521 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-30T04:54:08.523 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:08.552 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.121) 0:01:33.943 ********* 2021-03-30T04:54:08.634 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-30T04:54:08.636 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:08.665 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.112) 0:01:34.056 ********* 2021-03-30T04:54:08.769 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-30T04:54:08.771 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-03-30T04:54:08.797 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.132) 0:01:34.188 ********* 2021-03-30T04:54:08.889 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-30T04:54:08.891 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-30T04:54:08.919 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:08 +0000 (0:00:00.121) 0:01:34.309 ********* 2021-03-30T04:54:09.008 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-30T04:54:09.010 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-03-30T04:54:09.036 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:09 +0000 (0:00:00.116) 0:01:34.426 ********* 2021-03-30T04:54:10.353 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-30T04:54:10.355 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1617080050.2093165-_hkg0ii8/katello-ca-consumer-latest.noarch9pg4uja1.rpm"]} 2021-03-30T04:54:10.375 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:10 +0000 (0:00:01.339) 0:01:35.765 ********* 2021-03-30T04:54:11.354 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-30T04:54:11.356 INFO:teuthology.task.ansible.out:fatal: [smithi197.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-03-30T04:54:11.380 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:11 +0000 (0:00:01.005) 0:01:36.771 ********* 2021-03-30T04:54:11.463 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-30T04:54:11.465 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-03-30T04:54:11.490 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:11 +0000 (0:00:00.109) 0:01:36.881 ********* 2021-03-30T04:54:27.157 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-30T04:54:27.159 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-30T04:54:27.178 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:27 +0000 (0:00:15.688) 0:01:52.569 ********* 2021-03-30T04:54:27.272 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-30T04:54:27.274 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-03-30T04:54:27.301 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:27 +0000 (0:00:00.119) 0:01:52.689 ********* 2021-03-30T04:54:28.196 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-30T04:54:28.198 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.642958", "end": "2021-03-30 04:54:28.169945", "failed_when_result": false, "rc": 0, "start": "2021-03-30 04:54:27.526987", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2021-03-30T04:54:28.220 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:28 +0000 (0:00:00.922) 0:01:53.611 ********* 2021-03-30T04:54:28.309 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-30T04:54:28.311 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:28.332 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:28 +0000 (0:00:00.111) 0:01:53.723 ********* 2021-03-30T04:54:28.401 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-30T04:54:28.403 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:28.433 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:28 +0000 (0:00:00.101) 0:01:53.824 ********* 2021-03-30T04:54:28.503 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-30T04:54:28.505 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-30T04:54:28.537 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:28 +0000 (0:00:00.103) 0:01:53.928 ********* 2021-03-30T04:54:28.608 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-30T04:54:28.610 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:28.641 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:28 +0000 (0:00:00.104) 0:01:54.032 ********* 2021-03-30T04:54:32.109 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:03.199680", "end": "2021-03-30 04:54:32.083064", "rc": 0, "start": "2021-03-30 04:54:28.883384", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-03-30T04:54:32.132 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:32 +0000 (0:00:03.491) 0:01:57.523 ********* 2021-03-30T04:54:32.222 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-30T04:54:32.224 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-03-30T04:54:32.246 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:32 +0000 (0:00:00.114) 0:01:57.637 ********* 2021-03-30T04:54:32.318 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-30T04:54:32.320 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:32.344 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:32 +0000 (0:00:00.096) 0:01:57.734 ********* 2021-03-30T04:54:32.434 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-30T04:54:32.437 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-03-30T04:54:32.466 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:32 +0000 (0:00:00.123) 0:01:57.857 ********* 2021-03-30T04:54:32.548 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-30T04:54:32.550 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-03-30T04:54:32.573 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:32 +0000 (0:00:00.106) 0:01:57.964 ********* 2021-03-30T04:54:36.448 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-30T04:54:36.450 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-30T04:54:36.470 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:36 +0000 (0:00:03.896) 0:02:01.860 ********* 2021-03-30T04:54:39.341 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-30T04:54:39.343 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:02.639815", "end": "2021-03-30 04:54:39.321148", "rc": 0, "start": "2021-03-30 04:54:36.681333", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-03-30T04:54:39.372 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:39 +0000 (0:00:02.902) 0:02:04.763 ********* 2021-03-30T04:54:39.916 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-03-30T04:54:39.950 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:39 +0000 (0:00:00.577) 0:02:05.341 ********* 2021-03-30T04:54:40.205 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-30T04:54:40.207 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-30T04:54:40.227 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:40 +0000 (0:00:00.277) 0:02:05.618 ********* 2021-03-30T04:54:40.744 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-30T04:54:40.746 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-03-30T04:54:41.195 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-03-30T04:54:41.222 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:41 +0000 (0:00:00.994) 0:02:06.613 ********* 2021-03-30T04:54:41.760 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-30T04:54:41.762 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-03-30T04:54:42.220 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-03-30T04:54:42.244 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:01.022) 0:02:07.635 ********* 2021-03-30T04:54:42.326 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-30T04:54:42.328 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.348 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:00.104) 0:02:07.739 ********* 2021-03-30T04:54:42.417 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-30T04:54:42.419 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.439 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:00.090) 0:02:07.830 ********* 2021-03-30T04:54:42.497 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-30T04:54:42.499 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.520 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:00.080) 0:02:07.911 ********* 2021-03-30T04:54:42.578 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-30T04:54:42.580 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.601 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:00.080) 0:02:07.992 ********* 2021-03-30T04:54:42.690 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-30T04:54:42.693 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.701 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.703 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.712 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.735 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:00.134) 0:02:08.126 ********* 2021-03-30T04:54:42.805 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-30T04:54:42.807 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.826 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:00.091) 0:02:08.217 ********* 2021-03-30T04:54:42.904 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-30T04:54:42.906 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:42.926 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:42 +0000 (0:00:00.099) 0:02:08.316 ********* 2021-03-30T04:54:43.004 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:43.026 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:43 +0000 (0:00:00.100) 0:02:08.417 ********* 2021-03-30T04:54:43.095 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-30T04:54:43.097 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:43.127 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:43 +0000 (0:00:00.101) 0:02:08.518 ********* 2021-03-30T04:54:43.198 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-30T04:54:43.200 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:43.219 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:43 +0000 (0:00:00.091) 0:02:08.610 ********* 2021-03-30T04:54:43.531 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-30T04:54:43.533 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.105221", "end": "2021-03-30 04:54:43.500351", "rc": 0, "start": "2021-03-30 04:54:43.395130", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:54:43.555 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:43 +0000 (0:00:00.335) 0:02:08.946 ********* 2021-03-30T04:54:46.572 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:54:46.594 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:46 +0000 (0:00:03.039) 0:02:11.985 ********* 2021-03-30T04:54:46.673 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:46.703 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:46 +0000 (0:00:00.108) 0:02:12.094 ********* 2021-03-30T04:54:46.793 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-30T04:54:46.795 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:46.816 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:46 +0000 (0:00:00.112) 0:02:12.206 ********* 2021-03-30T04:54:46.884 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-30T04:54:46.885 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:46.905 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:46 +0000 (0:00:00.089) 0:02:12.296 ********* 2021-03-30T04:54:46.972 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-30T04:54:46.974 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:46.995 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:46 +0000 (0:00:00.089) 0:02:12.386 ********* 2021-03-30T04:54:47.506 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-03-30T04:54:47.539 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:47 +0000 (0:00:00.543) 0:02:12.930 ********* 2021-03-30T04:54:50.179 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-30T04:54:50.181 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:54:50.205 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:50 +0000 (0:00:02.666) 0:02:15.596 ********* 2021-03-30T04:54:50.837 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-30T04:54:50.841 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-03-30T04:54:51.342 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-03-30T04:54:51.785 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-03-30T04:54:51.813 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:51 +0000 (0:00:01.607) 0:02:17.203 ********* 2021-03-30T04:54:52.009 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-30T04:54:52.035 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:52 +0000 (0:00:00.222) 0:02:17.426 ********* 2021-03-30T04:54:52.596 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-30T04:54:52.599 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-03-30T04:54:53.050 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-03-30T04:54:53.483 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-03-30T04:54:53.508 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:53 +0000 (0:00:01.472) 0:02:18.899 ********* 2021-03-30T04:54:53.604 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:54:53.635 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:53 +0000 (0:00:00.126) 0:02:19.026 ********* 2021-03-30T04:54:53.717 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-30T04:54:53.719 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-03-30T04:54:53.741 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:53 +0000 (0:00:00.105) 0:02:19.131 ********* 2021-03-30T04:54:54.000 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-03-30T04:54:54.033 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:54 +0000 (0:00:00.291) 0:02:19.423 ********* 2021-03-30T04:54:54.125 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-30T04:54:54.127 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:54.136 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:54.148 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:54.159 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-30T04:54:54.182 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:54:54 +0000 (0:00:00.149) 0:02:19.573 ********* 2021-03-30T04:55:01.613 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common-4.4.6-4.el8.x86_64", "Installed: nrpe-4.0.3-6.el8.x86_64", "Removed: nagios-common-4.4.5-1.el8.x86_64", "Removed: nrpe-4.0.3-1.el8.x86_64"]} 2021-03-30T04:55:01.639 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:01 +0000 (0:00:07.456) 0:02:27.030 ********* 2021-03-30T04:55:01.719 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:01.741 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:01 +0000 (0:00:00.101) 0:02:27.132 ********* 2021-03-30T04:55:02.310 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-03-30T04:55:02.338 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:02 +0000 (0:00:00.591) 0:02:27.724 ********* 2021-03-30T04:55:02.872 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-30T04:55:02.875 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-03-30T04:55:02.907 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:02 +0000 (0:00:00.573) 0:02:28.298 ********* 2021-03-30T04:55:03.021 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-30T04:55:03.023 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-03-30T04:55:03.044 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-03-30T04:55:03.078 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:03 +0000 (0:00:00.171) 0:02:28.469 ********* 2021-03-30T04:55:03.344 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-30T04:55:03.371 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:03 +0000 (0:00:00.292) 0:02:28.762 ********* 2021-03-30T04:55:03.682 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi197.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-03-30T04:55:03.703 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:03 +0000 (0:00:00.332) 0:02:29.094 ********* 2021-03-30T04:55:03.787 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-30T04:55:03.789 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:03.809 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:03 +0000 (0:00:00.105) 0:02:29.200 ********* 2021-03-30T04:55:04.319 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-30T04:55:04.322 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-03-30T04:55:04.350 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:04 +0000 (0:00:00.541) 0:02:29.741 ********* 2021-03-30T04:55:05.173 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-30T04:55:05.174 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2021-03-30 04:54:58 UTC", "ActiveEnterTimestampMonotonic": "208966074", "ActiveExitTimestamp": "Tue 2021-03-30 04:54:58 UTC", "ActiveExitTimestampMonotonic": "208941966", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount systemd-journald.socket sysinit.target tmp.mount time-sync.target local-fs.target var-run.mount nss-lookup.target system.slice basic.target network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-30 04:54:58 UTC", "AssertTimestampMonotonic": "208965020", "Before": "multi-user.target shutdown.target xdm.service getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-30 04:54:58 UTC", "ConditionTimestampMonotonic": "208965019", "Configuratio 2021-03-30T04:55:05.175 INFO:teuthology.task.ansible.out:nDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16007", "ExecMainStartTimestamp": "Tue 2021-03-30 04:54:58 UTC", "ExecMainStartTimestampMonotonic": "208966047", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Tue 2021-03-30 04:54:58 UTC", "InactiveEnterTimestampMonotonic": "208964336", "InactiveExitTimestamp": "Tue 2021-03-30 04:54:58 UTC", "InactiveExitTimestampMonotonic": "208966074", "InvocationID": "49c62d7311114a8fbcbbef332e254170", "JobRunningTimeoutUSec": "infini 2021-03-30T04:55:05.177 INFO:teuthology.task.ansible.out:ty", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "16007", "MemoryAccounting": "yes", "MemoryCurrent": "880640", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "Pr 2021-03-30T04:55:05.178 INFO:teuthology.task.ansible.out:otectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-30 04:54:58 UTC", "StateChangeTimestampMonotonic": "208966074", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203620", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-30 04:54:58 UTC", "WatchdogTimestampMonotonic": "208966072", "WatchdogUSec": "0"}} 2021-03-30T04:55:05.206 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:05 +0000 (0:00:00.856) 0:02:30.597 ********* 2021-03-30T04:55:05.444 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-30T04:55:05.446 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001798", "end": "2021-03-30 04:55:05.423324", "rc": 0, "start": "2021-03-30 04:55:05.421526", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-03-30T04:55:05.466 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:05 +0000 (0:00:00.259) 0:02:30.857 ********* 2021-03-30T04:55:08.202 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-30T04:55:08.204 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:55:08.225 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:08 +0000 (0:00:02.758) 0:02:33.616 ********* 2021-03-30T04:55:11.168 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:55:11.190 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:11 +0000 (0:00:02.964) 0:02:36.581 ********* 2021-03-30T04:55:12.667 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-03-30T04:55:12.694 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:12 +0000 (0:00:01.504) 0:02:38.085 ********* 2021-03-30T04:55:29.182 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-30T04:55:29.185 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.231325", "end": "2021-03-30 04:55:29.151630", "failed_when_result": false, "rc": 0, "start": "2021-03-30 04:55:12.920305", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-03-30T04:55:29.204 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:29 +0000 (0:00:16.510) 0:02:54.595 ********* 2021-03-30T04:55:29.742 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-30T04:55:29.744 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-03-30T04:55:29.765 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:29 +0000 (0:00:00.559) 0:02:55.155 ********* 2021-03-30T04:55:30.023 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-30T04:55:30.025 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013706", "end": "2021-03-30 04:55:29.994411", "rc": 0, "start": "2021-03-30 04:55:29.980705", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:55:30.055 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:30 +0000 (0:00:00.291) 0:02:55.446 ********* 2021-03-30T04:55:30.311 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-30T04:55:30.313 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002178", "end": "2021-03-30 04:55:30.285927", "rc": 0, "start": "2021-03-30 04:55:30.283749", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:55:30.341 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:30 +0000 (0:00:00.285) 0:02:55.731 ********* 2021-03-30T04:55:47.240 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-30T04:55:47.243 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.649926", "end": "2021-03-30 04:55:47.217059", "rc": 0, "start": "2021-03-30 04:55:30.567133", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:55:47.267 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:47 +0000 (0:00:16.926) 0:03:12.657 ********* 2021-03-30T04:55:47.515 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-30T04:55:47.517 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-03-30T04:55:47.537 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:47 +0000 (0:00:00.270) 0:03:12.928 ********* 2021-03-30T04:55:47.619 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-30T04:55:47.621 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-03-30T04:55:47.650 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:47 +0000 (0:00:00.110) 0:03:13.038 ********* 2021-03-30T04:55:47.738 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-30T04:55:47.740 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-30T04:55:47.760 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:47 +0000 (0:00:00.112) 0:03:13.151 ********* 2021-03-30T04:55:47.842 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-03-30T04:55:47.869 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:47 +0000 (0:00:00.102) 0:03:13.254 ********* 2021-03-30T04:55:47.966 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-30T04:55:48.000 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:47 +0000 (0:00:00.136) 0:03:13.390 ********* 2021-03-30T04:55:48.211 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-03-30T04:55:48.242 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:48 +0000 (0:00:00.241) 0:03:13.632 ********* 2021-03-30T04:55:48.491 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-30T04:55:48.493 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-30T04:55:48.518 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:48 +0000 (0:00:00.277) 0:03:13.909 ********* 2021-03-30T04:55:48.578 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-30T04:55:48.580 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:48.601 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:48 +0000 (0:00:00.081) 0:03:13.991 ********* 2021-03-30T04:55:48.658 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:48.681 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:48 +0000 (0:00:00.080) 0:03:14.071 ********* 2021-03-30T04:55:48.968 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi197.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-03-30T04:55:48.998 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:48 +0000 (0:00:00.316) 0:03:14.388 ********* 2021-03-30T04:55:49.614 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-30T04:55:49.616 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-03-30T04:55:49.649 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:49 +0000 (0:00:00.650) 0:03:15.039 ********* 2021-03-30T04:55:49.719 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi197"}, "changed": false} 2021-03-30T04:55:49.748 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:49 +0000 (0:00:00.099) 0:03:15.139 ********* 2021-03-30T04:55:50.849 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi197", "ansible_hostname": "smithi197", "ansible_nodename": "smithi197"}, "changed": false, "name": "smithi197"} 2021-03-30T04:55:50.870 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:50 +0000 (0:00:01.121) 0:03:16.261 ********* 2021-03-30T04:55:51.379 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-30T04:55:51.380 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-03-30T04:55:51.412 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:51 +0000 (0:00:00.542) 0:03:16.803 ********* 2021-03-30T04:55:51.934 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-30T04:55:51.941 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-03-30T04:55:51.966 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:51 +0000 (0:00:00.553) 0:03:17.356 ********* 2021-03-30T04:55:52.664 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-30T04:55:52.667 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-30T04:55:52.698 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:52 +0000 (0:00:00.732) 0:03:18.089 ********* 2021-03-30T04:55:53.272 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-03-30T04:55:53.295 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:53 +0000 (0:00:00.596) 0:03:18.685 ********* 2021-03-30T04:55:53.581 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-30T04:55:53.583 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-03-30T04:55:53.603 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:53 +0000 (0:00:00.308) 0:03:18.994 ********* 2021-03-30T04:55:53.841 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-30T04:55:53.843 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-03-30T04:55:53.864 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:53 +0000 (0:00:00.260) 0:03:19.254 ********* 2021-03-30T04:55:54.136 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-30T04:55:54.137 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-30T04:55:54.169 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:54 +0000 (0:00:00.305) 0:03:19.560 ********* 2021-03-30T04:55:54.698 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-30T04:55:54.700 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-03-30T04:55:54.721 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:54 +0000 (0:00:00.552) 0:03:20.112 ********* 2021-03-30T04:55:55.262 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-03-30T04:55:55.284 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:55 +0000 (0:00:00.562) 0:03:20.674 ********* 2021-03-30T04:55:57.547 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-30T04:55:57.549 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.022941", "end": "2021-03-30 04:55:57.516724", "rc": 0, "start": "2021-03-30 04:55:55.493783", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:55:57.581 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:57 +0000 (0:00:02.296) 0:03:22.971 ********* 2021-03-30T04:55:57.653 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-30T04:55:57.656 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:57.676 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:57 +0000 (0:00:00.095) 0:03:23.067 ********* 2021-03-30T04:55:58.229 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-30T04:55:58.231 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-03-30T04:55:58.257 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.580) 0:03:23.647 ********* 2021-03-30T04:55:58.314 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-30T04:55:58.338 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.081) 0:03:23.729 ********* 2021-03-30T04:55:58.407 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-30T04:55:58.436 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.097) 0:03:23.826 ********* 2021-03-30T04:55:58.507 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-30T04:55:58.509 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:58.538 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.102) 0:03:23.929 ********* 2021-03-30T04:55:58.654 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-30T04:55:58.676 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.137) 0:03:24.066 ********* 2021-03-30T04:55:58.754 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-30T04:55:58.757 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:58.779 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.103) 0:03:24.170 ********* 2021-03-30T04:55:58.859 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:58.880 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.101) 0:03:24.271 ********* 2021-03-30T04:55:58.978 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:58.994 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:58 +0000 (0:00:00.113) 0:03:24.385 ********* 2021-03-30T04:55:59.063 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:59.095 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:59 +0000 (0:00:00.100) 0:03:24.485 ********* 2021-03-30T04:55:59.352 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-30T04:55:59.353 INFO:teuthology.task.ansible.out:fatal: [smithi197.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007223", "end": "2021-03-30 04:55:59.327049", "msg": "non-zero return code", "rc": 1, "start": "2021-03-30 04:55:59.319826", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-03-30T04:55:59.374 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:59 +0000 (0:00:00.278) 0:03:24.764 ********* 2021-03-30T04:55:59.441 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-30T04:55:59.443 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:55:59.465 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:55:59 +0000 (0:00:00.089) 0:03:24.854 ********* 2021-03-30T04:56:05.876 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+9828+7aab3355.3.x86_64"]} 2021-03-30T04:56:05.905 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:05 +0000 (0:00:06.440) 0:03:31.295 ********* 2021-03-30T04:56:11.937 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-30T04:56:11.942 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-03-30T04:56:11.964 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:11 +0000 (0:00:06.059) 0:03:37.355 ********* 2021-03-30T04:56:22.464 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-30T04:56:22.466 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: qemu-img-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+9903+ca3e42fb.4.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: qemu-img-15:4.2.0-34.module+el8.3.0+9828+7aab3355.3.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+9828+7aab3355.3.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+9828+7aab3355.3.x86_64"]} 2021-03-30T04:56:22.487 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:22 +0000 (0:00:10.522) 0:03:47.877 ********* 2021-03-30T04:56:25.260 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-30T04:56:25.262 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:56:25.282 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:25 +0000 (0:00:02.795) 0:03:50.673 ********* 2021-03-30T04:56:28.111 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-30T04:56:28.113 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:56:28.144 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:28 +0000 (0:00:02.862) 0:03:53.535 ********* 2021-03-30T04:56:28.217 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-30T04:56:28.219 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:28.251 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:28 +0000 (0:00:00.106) 0:03:53.641 ********* 2021-03-30T04:56:28.621 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-30T04:56:28.623 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket basic.target dbus.service system.slice sysinit.target polkit.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "nftables.service ipset.service shutdown.target iptables.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "Ef 2021-03-30T04:56:28.625 INFO:teuthology.task.ansible.out:fectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "Limi 2021-03-30T04:56:28.627 INFO:teuthology.task.ansible.out:tRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set 2021-03-30T04:56:28.629 INFO:teuthology.task.ansible.out:]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203620", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-30T04:56:28.646 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:28 +0000 (0:00:00.395) 0:03:54.037 ********* 2021-03-30T04:56:28.988 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-30T04:56:28.990 INFO:teuthology.task.ansible.out:fatal: [smithi197.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-03-30T04:56:29.011 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:29 +0000 (0:00:00.364) 0:03:54.402 ********* 2021-03-30T04:56:29.783 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-30T04:56:29.785 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-03-30T04:56:29.805 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:29 +0000 (0:00:00.794) 0:03:55.196 ********* 2021-03-30T04:56:29.884 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-30T04:56:29.886 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:29.906 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:29 +0000 (0:00:00.100) 0:03:55.297 ********* 2021-03-30T04:56:29.968 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-30T04:56:29.970 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:29.991 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:29 +0000 (0:00:00.083) 0:03:55.381 ********* 2021-03-30T04:56:30.059 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-30T04:56:30.061 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.086 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.096) 0:03:55.477 ********* 2021-03-30T04:56:30.159 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-30T04:56:30.160 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.192 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.105) 0:03:55.583 ********* 2021-03-30T04:56:30.262 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-30T04:56:30.264 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.290 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.097) 0:03:55.680 ********* 2021-03-30T04:56:30.370 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-30T04:56:30.370 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.393 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.103) 0:03:55.784 ********* 2021-03-30T04:56:30.467 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-30T04:56:30.487 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.093) 0:03:55.877 ********* 2021-03-30T04:56:30.547 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.572 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.081) 0:03:55.959 ********* 2021-03-30T04:56:30.641 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.663 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.094) 0:03:56.054 ********* 2021-03-30T04:56:30.743 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-30T04:56:30.745 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.767 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.103) 0:03:56.157 ********* 2021-03-30T04:56:30.871 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-30T04:56:30.872 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:30.906 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.139) 0:03:56.297 ********* 2021-03-30T04:56:30.975 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-30T04:56:30.997 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:30 +0000 (0:00:00.091) 0:03:56.388 ********* 2021-03-30T04:56:31.078 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-30T04:56:31.079 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.103 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.104) 0:03:56.493 ********* 2021-03-30T04:56:31.183 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-30T04:56:31.185 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.208 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.105) 0:03:56.599 ********* 2021-03-30T04:56:31.305 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-30T04:56:31.307 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.332 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.124) 0:03:56.723 ********* 2021-03-30T04:56:31.424 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-30T04:56:31.426 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.450 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.115) 0:03:56.839 ********* 2021-03-30T04:56:31.547 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.569 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.121) 0:03:56.960 ********* 2021-03-30T04:56:31.660 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.683 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.111) 0:03:57.072 ********* 2021-03-30T04:56:31.774 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-30T04:56:31.777 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.796 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.114) 0:03:57.187 ********* 2021-03-30T04:56:31.901 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:31.929 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:31 +0000 (0:00:00.132) 0:03:57.319 ********* 2021-03-30T04:56:32.015 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.042 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.114) 0:03:57.433 ********* 2021-03-30T04:56:32.113 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-30T04:56:32.114 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.135 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.092) 0:03:57.526 ********* 2021-03-30T04:56:32.238 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.265 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.128) 0:03:57.655 ********* 2021-03-30T04:56:32.344 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.370 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.105) 0:03:57.760 ********* 2021-03-30T04:56:32.463 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.492 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.120) 0:03:57.880 ********* 2021-03-30T04:56:32.569 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.592 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.101) 0:03:57.982 ********* 2021-03-30T04:56:32.660 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.683 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.089) 0:03:58.072 ********* 2021-03-30T04:56:32.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-30T04:56:32.752 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.781 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.097) 0:03:58.170 ********* 2021-03-30T04:56:32.839 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.864 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.084) 0:03:58.255 ********* 2021-03-30T04:56:32.926 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:32.949 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:32 +0000 (0:00:00.084) 0:03:58.339 ********* 2021-03-30T04:56:33.040 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-30T04:56:33.042 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.062 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.113) 0:03:58.453 ********* 2021-03-30T04:56:33.121 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.151 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.089) 0:03:58.542 ********* 2021-03-30T04:56:33.232 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.260 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.103) 0:03:58.646 ********* 2021-03-30T04:56:33.331 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.362 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.106) 0:03:58.752 ********* 2021-03-30T04:56:33.457 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.477 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.115) 0:03:58.868 ********* 2021-03-30T04:56:33.566 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-30T04:56:33.568 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.589 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.111) 0:03:58.980 ********* 2021-03-30T04:56:33.667 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-30T04:56:33.669 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.700 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.111) 0:03:59.091 ********* 2021-03-30T04:56:33.784 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.811 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.111) 0:03:59.202 ********* 2021-03-30T04:56:33.895 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-30T04:56:33.897 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:33.926 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:33 +0000 (0:00:00.114) 0:03:59.317 ********* 2021-03-30T04:56:33.998 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-30T04:56:34.000 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.022 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.096) 0:03:59.413 ********* 2021-03-30T04:56:34.102 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.125 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.102) 0:03:59.516 ********* 2021-03-30T04:56:34.196 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.218 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.092) 0:03:59.609 ********* 2021-03-30T04:56:34.299 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-30T04:56:34.301 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.322 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.103) 0:03:59.713 ********* 2021-03-30T04:56:34.392 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-30T04:56:34.393 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.418 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.094) 0:03:59.808 ********* 2021-03-30T04:56:34.499 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-30T04:56:34.501 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.522 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.104) 0:03:59.912 ********* 2021-03-30T04:56:34.593 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-30T04:56:34.595 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.615 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.093) 0:04:00.006 ********* 2021-03-30T04:56:34.684 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.717 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.101) 0:04:00.108 ********* 2021-03-30T04:56:34.788 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-30T04:56:34.790 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.816 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.099) 0:04:00.207 ********* 2021-03-30T04:56:34.886 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-30T04:56:34.888 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:34.910 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:34 +0000 (0:00:00.091) 0:04:00.299 ********* 2021-03-30T04:56:34.987 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-30T04:56:34.989 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.010 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.102) 0:04:00.401 ********* 2021-03-30T04:56:35.079 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-30T04:56:35.081 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.106 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.094) 0:04:00.496 ********* 2021-03-30T04:56:35.176 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.205 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.099) 0:04:00.596 ********* 2021-03-30T04:56:35.296 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-30T04:56:35.298 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.318 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.113) 0:04:00.709 ********* 2021-03-30T04:56:35.387 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.407 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.088) 0:04:00.797 ********* 2021-03-30T04:56:35.490 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.513 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.105) 0:04:00.903 ********* 2021-03-30T04:56:35.593 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-30T04:56:35.596 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.616 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.103) 0:04:01.006 ********* 2021-03-30T04:56:35.696 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.720 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.103) 0:04:01.110 ********* 2021-03-30T04:56:35.803 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-30T04:56:35.805 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.825 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.105) 0:04:01.216 ********* 2021-03-30T04:56:35.896 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:35.918 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:35 +0000 (0:00:00.092) 0:04:01.309 ********* 2021-03-30T04:56:35.987 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-30T04:56:35.989 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.009 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.091) 0:04:01.400 ********* 2021-03-30T04:56:36.079 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-30T04:56:36.082 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.114 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.101) 0:04:01.502 ********* 2021-03-30T04:56:36.183 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-30T04:56:36.185 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.210 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.099) 0:04:01.601 ********* 2021-03-30T04:56:36.280 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.302 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.091) 0:04:01.692 ********* 2021-03-30T04:56:36.400 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-30T04:56:36.404 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.425 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.123) 0:04:01.816 ********* 2021-03-30T04:56:36.484 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.509 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.083) 0:04:01.899 ********* 2021-03-30T04:56:36.577 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-30T04:56:36.579 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-30T04:56:36.602 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.093) 0:04:01.993 ********* 2021-03-30T04:56:36.694 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-30T04:56:36.696 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.706 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-30T04:56:36.728 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.730 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.750 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.752 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-30T04:56:36.787 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:36 +0000 (0:00:00.185) 0:04:02.178 ********* 2021-03-30T04:56:37.069 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-30T04:56:37.071 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004269", "end": "2021-03-30 04:56:37.045866", "rc": 0, "start": "2021-03-30 04:56:37.041597", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_9870012c9b43ad9e4e27984868ce0706e230f04f/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_9870012c9b43ad9e4e27984868ce0706e230f04f/virtualenv/bin/teuthology-lock"]} 2021-03-30T04:56:37.104 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:37 +0000 (0:00:00.316) 0:04:02.495 ********* 2021-03-30T04:56:37.175 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:37.200 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:37 +0000 (0:00:00.096) 0:04:02.591 ********* 2021-03-30T04:56:37.272 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:37.294 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:37 +0000 (0:00:00.094) 0:04:02.685 ********* 2021-03-30T04:56:37.367 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-30T04:56:37.369 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:37.395 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:37 +0000 (0:00:00.096) 0:04:02.782 ********* 2021-03-30T04:56:37.461 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-30T04:56:37.463 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:37.486 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:37 +0000 (0:00:00.094) 0:04:02.876 ********* 2021-03-30T04:56:40.273 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:56:40.305 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:40 +0000 (0:00:02.818) 0:04:05.695 ********* 2021-03-30T04:56:40.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-30T04:56:40.390 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930338136064, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227133334, 'block_used': 12961774, 'inode_total': 61054976, 'inode_available': 60982602, 'inode_used': 72374, 'uuid': 'c096f242-fd72-47b4-aa1d-3d6c1f58c5b6'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227133334, "block_size": 4096, "block_total": 240095108, "block_used": 12961774, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60982602, "inode_total": 61054976, "inode_used": 72374, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930338136064, "size_total": 983429562368, "uuid": "c096f242-fd72-47b4-aa1d-3d6c1f58c5b6"}} 2021-03-30T04:56:40.427 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:40 +0000 (0:00:00.115) 0:04:05.811 ********* 2021-03-30T04:56:40.683 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-30T04:56:40.686 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004962", "end": "2021-03-30 04:56:40.662475", "rc": 0, "start": "2021-03-30 04:56:40.657513", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:40.711 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:40 +0000 (0:00:00.290) 0:04:06.101 ********* 2021-03-30T04:56:40.791 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi197.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930338136064, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227133334, 'block_used': 12961774, 'inode_total': 61054976, 'inode_available': 60982602, 'inode_used': 72374, 'uuid': 'c096f242-fd72-47b4-aa1d-3d6c1f58c5b6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227133334, "block_size": 4096, "block_total": 240095108, "block_used": 12961774, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60982602, "inode_total": 61054976, "inode_used": 72374, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930338136064, "size_total": 983429562368, "uuid": "c096f242-fd72-47b4-aa1d-3d6c1f58c5b6"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:40.822 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:40 +0000 (0:00:00.110) 0:04:06.212 ********* 2021-03-30T04:56:40.894 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-30T04:56:40.921 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:40 +0000 (0:00:00.099) 0:04:06.311 ********* 2021-03-30T04:56:42.539 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-30T04:56:42.541 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsaUaCTCvApj3vv1KZ37amu6q3fOJXaVes'], 'uuids': ['98de6f7c-8e25-404f-bb63-e3366176d41c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.318566", "end": "2021-03-30 04:56:42.506441", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsaUaCTCvApj3vv1KZ37amu6q3fOJXaVes"], "labels": [], "masters": [], "uuids": ["98de6f7c-8e25-404f-bb63-e3366176d41c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:41.187875", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-30T04:56:43.789 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Zn5klc-ubTX-veDm-nhd3-7YkK-OH2C-ZM4f8d', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN', 'nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.061095", "end": "2021-03-30 04:56:43.757118", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Zn5klc-ubTX-veDm-nhd3-7YkK-OH2C-ZM4f8d", "nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN", "nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:42.696023", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-03-30T04:56:43.790 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-30T04:56:45.040 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsN2CZ53rSOYflCzdNYsKf3NFWPX7GKjli'], 'uuids': ['d8824123-3ba8-4994-80c2-678ac9af7e4b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.054663", "end": "2021-03-30 04:56:45.006364", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsN2CZ53rSOYflCzdNYsKf3NFWPX7GKjli"], "labels": [], "masters": [], "uuids": ["d8824123-3ba8-4994-80c2-678ac9af7e4b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:43.951701", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-30T04:56:46.291 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsEWOfe0JC9UB48g3VcXctOnQsnI5R2Jn3'], 'uuids': ['a3c55d93-a34f-4b3a-ad3b-efd722a7b29c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.045458", "end": "2021-03-30 04:56:46.257100", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsEWOfe0JC9UB48g3VcXctOnQsnI5R2Jn3"], "labels": [], "masters": [], "uuids": ["a3c55d93-a34f-4b3a-ad3b-efd722a7b29c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:45.211642", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-30T04:56:47.534 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsZmLQQC43qIvgJU9XjnZGUUUpPTOe4slg'], 'uuids': ['f062705e-cdda-4c8c-8138-56504ebfa309'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.053706", "end": "2021-03-30 04:56:47.507984", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsZmLQQC43qIvgJU9XjnZGUUUpPTOe4slg"], "labels": [], "masters": [], "uuids": ["f062705e-cdda-4c8c-8138-56504ebfa309"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:46.454278", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-30T04:56:47.546 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XK3R', 'scsi-35000c5009293d217', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R', 'wwn-0x5000c5009293d217'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XK3R', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293d217', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XK3R-part1', 'scsi-35000c5009293d217-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R-part1', 'wwn-0x5000c5009293d217-part1'], 'uuids': ['c096f242-fd72-47b4-aa1d-3d6c1f58c5b6'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'c096f242-fd72-47b4-aa1d-3d6c1f58c5b6', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XK3R", "scsi-35000c5009293d217", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R", "wwn-0x5000c5009293d217"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-03-30T04:56:47.548 INFO:teuthology.task.ansible.out:Z1W5XK3R-part1", "scsi-35000c5009293d217-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R-part1", "wwn-0x5000c5009293d217-part1"], "labels": [], "masters": [], "uuids": ["c096f242-fd72-47b4-aa1d-3d6c1f58c5b6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c096f242-fd72-47b4-aa1d-3d6c1f58c5b6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XK3R", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d217"}}, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:48.800 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsdAcPerlmLEm2l1Z3fQlakKQ6INA8VT4G'], 'uuids': ['e78ae770-715a-4d42-aa47-1b4a1f501555'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.058355", "end": "2021-03-30 04:56:48.765850", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsdAcPerlmLEm2l1Z3fQlakKQ6INA8VT4G"], "labels": [], "masters": [], "uuids": ["e78ae770-715a-4d42-aa47-1b4a1f501555"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:47.707495", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-30T04:56:48.829 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:48 +0000 (0:00:07.908) 0:04:14.220 ********* 2021-03-30T04:56:49.222 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-30T04:56:49.224 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsaUaCTCvApj3vv1KZ37amu6q3fOJXaVes'], 'uuids': ['98de6f7c-8e25-404f-bb63-e3366176d41c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139048", "end": "2021-03-30 04:56:49.195252", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsaUaCTCvApj3vv1KZ37amu6q3fOJXaVes"], "labels": [], "masters": [], "uuids": ["98de6f7c-8e25-404f-bb63-e3366176d41c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:49.056204", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136445 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136445 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:49.446 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Zn5klc-ubTX-veDm-nhd3-7YkK-OH2C-ZM4f8d', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN', 'nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037762", "end": "2021-03-30 04:56:49.422327", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Zn5klc-ubTX-veDm-nhd3-7YkK-OH2C-ZM4f8d", "nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN", "nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:49.384565", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0351083 s, 3.3 GB/s", "std 2021-03-30T04:56:49.448 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0351083 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:49.772 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsN2CZ53rSOYflCzdNYsKf3NFWPX7GKjli'], 'uuids': ['d8824123-3ba8-4994-80c2-678ac9af7e4b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.138839", "end": "2021-03-30 04:56:49.746376", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsN2CZ53rSOYflCzdNYsKf3NFWPX7GKjli"], "labels": [], "masters": [], "uuids": ["d8824123-3ba8-4994-80c2-678ac9af7e4b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:49.607537", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136416 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136416 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:50.096 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsEWOfe0JC9UB48g3VcXctOnQsnI5R2Jn3'], 'uuids': ['a3c55d93-a34f-4b3a-ad3b-efd722a7b29c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138603", "end": "2021-03-30 04:56:50.067236", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsEWOfe0JC9UB48g3VcXctOnQsnI5R2Jn3"], "labels": [], "masters": [], "uuids": ["a3c55d93-a34f-4b3a-ad3b-efd722a7b29c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:49.928633", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135922 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135922 s, 849 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:50.423 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsZmLQQC43qIvgJU9XjnZGUUUpPTOe4slg'], 'uuids': ['f062705e-cdda-4c8c-8138-56504ebfa309'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.150102", "end": "2021-03-30 04:56:50.400759", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsZmLQQC43qIvgJU9XjnZGUUUpPTOe4slg"], "labels": [], "masters": [], "uuids": ["f062705e-cdda-4c8c-8138-56504ebfa309"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:50.250657", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147673 s, 781 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147673 s, 781 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:50.437 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XK3R', 'scsi-35000c5009293d217', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R', 'wwn-0x5000c5009293d217'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XK3R', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293d217', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XK3R-part1', 'scsi-35000c5009293d217-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R-part1', 'wwn-0x5000c5009293d217-part1'], 'uuids': ['c096f242-fd72-47b4-aa1d-3d6c1f58c5b6'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'c096f242-fd72-47b4-aa1d-3d6c1f58c5b6', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XK3R", "scsi-35000c5009293d217", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R", "wwn-0x5000c5009293d217"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XK3R-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-03-30T04:56:50.439 INFO:teuthology.task.ansible.out:Z1W5XK3R-part1", "scsi-35000c5009293d217-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XK3R-part1", "wwn-0x5000c5009293d217-part1"], "labels": [], "masters": [], "uuids": ["c096f242-fd72-47b4-aa1d-3d6c1f58c5b6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "c096f242-fd72-47b4-aa1d-3d6c1f58c5b6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XK3R", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d217"}}, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:50.756 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsdAcPerlmLEm2l1Z3fQlakKQ6INA8VT4G'], 'uuids': ['e78ae770-715a-4d42-aa47-1b4a1f501555'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.137770", "end": "2021-03-30 04:56:50.723282", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-KW8miFwvHTdeOiY8bzLZD3sT2u3xhPdsdAcPerlmLEm2l1Z3fQlakKQ6INA8VT4G"], "labels": [], "masters": [], "uuids": ["e78ae770-715a-4d42-aa47-1b4a1f501555"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-30 04:56:50.585512", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135147 s, 853 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135147 s, 853 MB/s"], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:50.790 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:50 +0000 (0:00:01.960) 0:04:16.181 ********* 2021-03-30T04:56:51.119 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.060152", "end": "2021-03-30 04:56:51.019531", "rc": 0, "start": "2021-03-30 04:56:50.959379", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:51.149 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:51 +0000 (0:00:00.358) 0:04:16.539 ********* 2021-03-30T04:56:51.385 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-30T04:56:51.386 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.042438", "end": "2021-03-30 04:56:51.362064", "rc": 0, "start": "2021-03-30 04:56:51.319626", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:56:51.416 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:51 +0000 (0:00:00.266) 0:04:16.806 ********* 2021-03-30T04:56:51.517 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-30T04:56:51.591 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:51 +0000 (0:00:00.175) 0:04:16.982 ********* 2021-03-30T04:56:51.620 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-30T04:56:51.622 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:51.653 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:51 +0000 (0:00:00.062) 0:04:17.044 ********* 2021-03-30T04:56:51.704 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-30T04:56:51.706 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:51.725 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:51 +0000 (0:00:00.072) 0:04:17.116 ********* 2021-03-30T04:56:51.764 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-30T04:56:51.766 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:51.788 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:51 +0000 (0:00:00.062) 0:04:17.179 ********* 2021-03-30T04:56:51.839 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-30T04:56:51.841 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:51.872 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:51 +0000 (0:00:00.083) 0:04:17.263 ********* 2021-03-30T04:56:52.110 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-30T04:56:52.132 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.259) 0:04:17.523 ********* 2021-03-30T04:56:52.171 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi197.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930338136064, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227133334, 'block_used': 12961774, 'inode_total': 61054976, 'inode_available': 60982602, 'inode_used': 72374, 'uuid': 'c096f242-fd72-47b4-aa1d-3d6c1f58c5b6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227133334, "block_size": 4096, "block_total": 240095108, "block_used": 12961774, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60982602, "inode_total": 61054976, "inode_used": 72374, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930338136064, "size_total": 983429562368, "uuid": "c096f242-fd72-47b4-aa1d-3d6c1f58c5b6"}, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:52.209 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.075) 0:04:17.599 ********* 2021-03-30T04:56:52.250 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:52.284 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.075) 0:04:17.675 ********* 2021-03-30T04:56:52.312 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-30T04:56:52.314 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:52.344 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.057) 0:04:17.732 ********* 2021-03-30T04:56:52.386 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:52.408 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.063) 0:04:17.796 ********* 2021-03-30T04:56:52.434 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:52.460 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.054) 0:04:17.851 ********* 2021-03-30T04:56:52.502 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:52.533 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.072) 0:04:17.923 ********* 2021-03-30T04:56:52.561 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-30T04:56:52.563 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:52.585 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:52 +0000 (0:00:00.052) 0:04:17.975 ********* 2021-03-30T04:56:53.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-30T04:56:53.401 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:53 +0000 (0:00:00.815) 0:04:18.791 ********* 2021-03-30T04:56:54.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-30T04:56:54.079 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-30T04:56:54.429 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-30T04:56:54.789 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-30T04:56:55.126 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-30T04:56:55.451 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-30T04:56:55.476 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:55 +0000 (0:00:02.075) 0:04:20.866 ********* 2021-03-30T04:56:55.691 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-30T04:56:55.693 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-30T04:56:55.727 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:55 +0000 (0:00:00.250) 0:04:21.117 ********* 2021-03-30T04:56:55.937 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-30T04:56:56.123 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-30T04:56:56.304 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-30T04:56:56.486 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-30T04:56:56.501 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:56.522 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:56 +0000 (0:00:00.795) 0:04:21.913 ********* 2021-03-30T04:56:56.561 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-30T04:56:56.563 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:56.582 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:56 +0000 (0:00:00.059) 0:04:21.973 ********* 2021-03-30T04:56:56.612 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-30T04:56:56.614 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:56.638 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:56 +0000 (0:00:00.055) 0:04:22.028 ********* 2021-03-30T04:56:56.847 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-30T04:56:56.849 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-30T04:56:56.872 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:56 +0000 (0:00:00.234) 0:04:22.263 ********* 2021-03-30T04:56:56.900 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-30T04:56:56.901 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:56.933 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:56 +0000 (0:00:00.061) 0:04:22.324 ********* 2021-03-30T04:56:57.513 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-30T04:56:57.515 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true} 2021-03-30T04:56:57.537 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:57 +0000 (0:00:00.603) 0:04:22.928 ********* 2021-03-30T04:56:58.180 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-30T04:56:58.183 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-30T04:56:58.212 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.674) 0:04:23.603 ********* 2021-03-30T04:56:58.254 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.286 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.073) 0:04:23.676 ********* 2021-03-30T04:56:58.314 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.336 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.050) 0:04:23.726 ********* 2021-03-30T04:56:58.367 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-30T04:56:58.369 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.391 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.054) 0:04:23.781 ********* 2021-03-30T04:56:58.420 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.450 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.058) 0:04:23.840 ********* 2021-03-30T04:56:58.477 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-30T04:56:58.480 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.504 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.053) 0:04:23.894 ********* 2021-03-30T04:56:58.536 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-30T04:56:58.538 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.570 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.065) 0:04:23.960 ********* 2021-03-30T04:56:58.601 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.625 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.055) 0:04:24.016 ********* 2021-03-30T04:56:58.655 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.677 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.050) 0:04:24.066 ********* 2021-03-30T04:56:58.703 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.724 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.048) 0:04:24.115 ********* 2021-03-30T04:56:58.757 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.787 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.057) 0:04:24.172 ********* 2021-03-30T04:56:58.809 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.841 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.058) 0:04:24.231 ********* 2021-03-30T04:56:58.882 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.906 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.065) 0:04:24.297 ********* 2021-03-30T04:56:58.934 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-30T04:56:58.936 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:58.966 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:58 +0000 (0:00:00.060) 0:04:24.357 ********* 2021-03-30T04:56:58.996 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-30T04:56:59.003 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:59.029 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:59 +0000 (0:00:00.061) 0:04:24.418 ********* 2021-03-30T04:56:59.057 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-30T04:56:59.059 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:56:59.092 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:59 +0000 (0:00:00.064) 0:04:24.482 ********* 2021-03-30T04:56:59.582 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-30T04:56:59.584 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-03-30T04:56:59.608 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:59 +0000 (0:00:00.516) 0:04:24.998 ********* 2021-03-30T04:56:59.934 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-30T04:56:59.937 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2021-03-30 04:51:45 UTC", "ActiveEnterTimestampMonotonic": "16384268", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-tmpfiles-setup.service tmp.mount sntp.service sysinit.target system.slice ntpdate.service ntpd.service -.mount systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2021-03-30 04:51:44 UTC", "AssertTimestampMonotonic": "15094624", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2021-03-30 04:51:44 UTC", "ConditionTimestampMonotonic": "15094574", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0 2021-03-30T04:56:59.939 INFO:teuthology.task.ansible.out:", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "926", "ExecMainStartTimestamp": "Tue 2021-03-30 04:51:45 UTC", "ExecMainStartTimestampMonotonic": "16270981", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2021-03-30 04:51:44 UTC", "InactiveExitTimestampMonotonic": "15109750", "InvocationID": "1673d932deed497e9e6e185ecbc59acc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity 2021-03-30T04:56:59.941 INFO:teuthology.task.ansible.out:", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "926", "MemoryAccounting": "yes", "MemoryCurrent": "2850816", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOn 2021-03-30T04:56:59.943 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2021-03-30 04:51:45 UTC", "StateChangeTimestampMonotonic": "16384268", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203620", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2021-03-30 04:51:45 UTC", "WatchdogTimestampMonotonic": "16270991", "WatchdogUSec": "0"}} 2021-03-30T04:56:59.967 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:56:59 +0000 (0:00:00.358) 0:04:25.357 ********* 2021-03-30T04:57:00.003 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-30T04:57:00.022 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:00 +0000 (0:00:00.055) 0:04:25.413 ********* 2021-03-30T04:57:00.060 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-30T04:57:00.063 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-30T04:57:00.095 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:00 +0000 (0:00:00.073) 0:04:25.486 ********* 2021-03-30T04:57:00.124 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-30T04:57:00.126 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:00.150 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:00 +0000 (0:00:00.054) 0:04:25.540 ********* 2021-03-30T04:57:00.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:00.216 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:00 +0000 (0:00:00.065) 0:04:25.606 ********* 2021-03-30T04:57:00.247 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-30T04:57:00.249 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:00.283 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:00 +0000 (0:00:00.067) 0:04:25.673 ********* 2021-03-30T04:57:00.498 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-30T04:57:00.500 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-03-30T04:57:00.526 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:00 +0000 (0:00:00.243) 0:04:25.916 ********* 2021-03-30T04:57:01.029 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-30T04:57:01.031 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-03-30T04:57:01.056 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:01 +0000 (0:00:00.529) 0:04:26.446 ********* 2021-03-30T04:57:02.580 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-03-30T04:57:02.603 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:02 +0000 (0:00:01.546) 0:04:27.992 ********* 2021-03-30T04:57:02.645 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:02.673 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:02 +0000 (0:00:00.071) 0:04:28.064 ********* 2021-03-30T04:57:02.720 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-30T04:57:02.722 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-03-30T04:57:02.750 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:02 +0000 (0:00:00.076) 0:04:28.141 ********* 2021-03-30T04:57:02.951 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-30T04:57:02.991 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:02 +0000 (0:00:00.235) 0:04:28.376 ********* 2021-03-30T04:57:03.014 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.045 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.060) 0:04:28.436 ********* 2021-03-30T04:57:03.086 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-30T04:57:03.120 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.074) 0:04:28.510 ********* 2021-03-30T04:57:03.149 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.176 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.056) 0:04:28.567 ********* 2021-03-30T04:57:03.390 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-30T04:57:03.430 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.244) 0:04:28.811 ********* 2021-03-30T04:57:03.635 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-30T04:57:03.637 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-30T04:57:03.668 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.246) 0:04:29.058 ********* 2021-03-30T04:57:03.707 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.735 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.063) 0:04:29.122 ********* 2021-03-30T04:57:03.785 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi197.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.796 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.809 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.850 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.109) 0:04:29.231 ********* 2021-03-30T04:57:03.892 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.907 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.917 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.943 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.101) 0:04:29.333 ********* 2021-03-30T04:57:03.970 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:03.996 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:03 +0000 (0:00:00.051) 0:04:29.385 ********* 2021-03-30T04:57:04.024 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-30T04:57:04.026 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:04.047 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:04 +0000 (0:00:00.051) 0:04:29.437 ********* 2021-03-30T04:57:04.074 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-30T04:57:04.076 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:04.099 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:04 +0000 (0:00:00.052) 0:04:29.489 ********* 2021-03-30T04:57:04.125 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-30T04:57:04.127 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:04.152 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:04 +0000 (0:00:00.052) 0:04:29.542 ********* 2021-03-30T04:57:04.182 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:04.212 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:04 +0000 (0:00:00.058) 0:04:29.600 ********* 2021-03-30T04:57:04.238 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-30T04:57:04.239 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:04.266 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:04 +0000 (0:00:00.057) 0:04:29.657 ********* 2021-03-30T04:57:04.304 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-30T04:57:04.306 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:04.352 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:04 +0000 (0:00:00.075) 0:04:29.732 ********* 2021-03-30T04:57:04.374 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-30T04:57:04.376 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:04.399 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:04 +0000 (0:00:00.055) 0:04:29.788 ********* 2021-03-30T04:57:04.623 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-30T04:57:04.625 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005090", "end": "2021-03-30 04:57:04.589637", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-30 04:57:04.584547", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:57:04.805 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003023", "end": "2021-03-30 04:57:04.770786", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-30 04:57:04.767763", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:57:05.996 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:01.003903", "end": "2021-03-30 04:57:05.955864", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-30 04:57:04.951961", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-30T04:57:06.219 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030285", "end": "2021-03-30 04:57:06.177857", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-30 04:57:06.147572", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:57:06.244 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:06 +0000 (0:00:01.846) 0:04:31.635 ********* 2021-03-30T04:57:06.270 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-30T04:57:06.292 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:06 +0000 (0:00:00.048) 0:04:31.683 ********* 2021-03-30T04:57:06.489 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-30T04:57:06.490 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-03-30T04:57:06.570 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-30T04:57:06.587 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:06 +0000 (0:00:00.293) 0:04:31.977 ********* 2021-03-30T04:57:07.236 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi197.front.sepia.ceph.com] 2021-03-30T04:57:07.285 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:07 +0000 (0:00:00.698) 0:04:32.675 ********* 2021-03-30T04:57:07.311 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-30T04:57:07.313 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:07.333 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:07 +0000 (0:00:00.048) 0:04:32.724 ********* 2021-03-30T04:57:07.360 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-30T04:57:07.362 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-03-30T04:57:07.383 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:07 +0000 (0:00:00.049) 0:04:32.774 ********* 2021-03-30T04:57:07.436 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-30T04:57:07.439 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-03-30T04:57:07.465 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:07 +0000 (0:00:00.081) 0:04:32.855 ********* 2021-03-30T04:57:10.220 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-30T04:57:10.222 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-03-30T04:57:10.242 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:10 +0000 (0:00:02.777) 0:04:35.633 ********* 2021-03-30T04:57:10.280 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-30T04:57:10.281 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-03-30T04:57:10.306 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:10 +0000 (0:00:00.064) 0:04:35.697 ********* 2021-03-30T04:57:10.339 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:10.355 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:10 +0000 (0:00:00.048) 0:04:35.746 ********* 2021-03-30T04:57:10.594 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi197.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-30T04:57:10.795 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-03-30T04:57:10.819 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:10 +0000 (0:00:00.464) 0:04:36.210 ********* 2021-03-30T04:57:11.354 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-30T04:57:11.356 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617080230.8943038-1735-14699285288847/source", "state": "file", "uid": 0} 2021-03-30T04:57:11.878 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1617080231.3919215-1735-47378132285846/source", "state": "file", "uid": 0} 2021-03-30T04:57:11.900 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:11 +0000 (0:00:01.080) 0:04:37.291 ********* 2021-03-30T04:57:15.377 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-93ogvl_t-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-93ogvl_t-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl" 2021-03-30T04:57:15.384 INFO:teuthology.task.ansible.out:, "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-30T04:57:15.401 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:15 +0000 (0:00:03.499) 0:04:40.791 ********* 2021-03-30T04:57:15.442 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-30T04:57:15.444 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:15.470 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:15 +0000 (0:00:00.070) 0:04:40.861 ********* 2021-03-30T04:57:15.518 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:15.540 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:15 +0000 (0:00:00.070) 0:04:40.931 ********* 2021-03-30T04:57:15.916 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-30T04:57:15.919 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.165206", "end": "2021-03-30 04:57:15.893083", "rc": 0, "start": "2021-03-30 04:57:15.727877", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-30T04:57:15.938 INFO:teuthology.task.ansible.out:Tuesday 30 March 2021 04:57:15 +0000 (0:00:00.398) 0:04:41.329 ********* 2021-03-30T04:57:15.974 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-30T04:57:16.040 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-30T04:57:16.042 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-30T04:57:16.044 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi197.front.sepia.ceph.com : ok=136 changed=42 unreachable=0 failed=0 skipped=175 rescued=0 ignored=4 Tuesday 30 March 2021 04:57:16 +0000 (0:00:00.105) 0:04:41.434 ********* =============================================================================== 2021-03-30T04:57:16.044 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 39.79s Create all admin users with sudo access. ------------------------------- 30.45s 2021-03-30T04:57:16.044 INFO:teuthology.task.ansible.out:common : nrpe - Load SELinux policy package ---------------------------- 16.93s common : nrpe - Remove SELinux policy package -------------------------- 16.51s common : Register with subscription-manager. --------------------------- 15.69s testnode : Install packages -------------------------------------------- 10.52s Remove revoked users --------------------------------------------------- 10.04s testnode : Zap all non-root disks --------------------------------------- 7.91s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 7.46s testnode : Ensure ceph packages are not present. ------------------------ 6.44s testnode : Ensure ceph dependency packages are not present. ------------- 6.06s common : Disable all rhsm repos ----------------------------------------- 3.90s container-host : Install registries-conf-ctl ---------------------------- 3.50s common : Get list of enabled RHSM repos --------------------------------- 3.49s common : Install Kerberos Packages (RedHat) ----------------------------- 3.04s common : nrpe - Ensure SELinux policy is up to date --------------------- 2.96s common : Enable necessary rhsm repos ------------------------------------ 2.90s testnode : Remove packages 2021-03-30T04:57:16.046 INFO:teuthology.task.ansible.out: ---------------------------------------------- 2.86s testnode : Make sure rpm dependencies are installed --------------------- 2.82s testnode : Install epel packages ---------------------------------------- 2.80s 2021-03-30T04:57:16.419 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi197.front.sepia.ceph.com')] 2021-03-30T04:57:16.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-30T04:57:16.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-30T04:57:16.497 DEBUG:teuthology.orchestra.run.smithi197:> true 2021-03-30T04:57:16.598 INFO:teuthology.run_tasks:Running task clock... 2021-03-30T04:57:16.682 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-30T04:57:16.683 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-30T04:57:16.687 DEBUG:teuthology.orchestra.run.smithi197:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-30T04:57:16.721 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-03-30T04:57:16.735 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-03-30T04:57:16.773 INFO:teuthology.orchestra.run.smithi197.stderr:sudo: ntpd: command not found 2021-03-30T04:57:16.780 INFO:teuthology.orchestra.run.smithi197.stdout:506 Cannot talk to daemon 2021-03-30T04:57:16.794 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-03-30T04:57:16.809 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-03-30T04:57:16.872 INFO:teuthology.orchestra.run.smithi197.stderr:bash: ntpq: command not found 2021-03-30T04:57:16.875 INFO:teuthology.orchestra.run.smithi197.stdout:210 Number of sources = 4 2021-03-30T04:57:16.875 INFO:teuthology.orchestra.run.smithi197.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-03-30T04:57:16.876 INFO:teuthology.orchestra.run.smithi197.stdout:=============================================================================== 2021-03-30T04:57:16.876 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-30T04:57:16.876 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-30T04:57:16.877 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-30T04:57:16.877 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-03-30T04:57:16.878 INFO:teuthology.run_tasks:Running task install... 2021-03-30T04:57:17.013 DEBUG:teuthology.task.install:project ceph 2021-03-30T04:57:17.014 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'e4949d651265114d7b464cd1e8986d9a31a26071'}} 2021-03-30T04:57:17.015 DEBUG:teuthology.task.install:config {'sha1': 'e4949d651265114d7b464cd1e8986d9a31a26071'} 2021-03-30T04:57:17.016 INFO:teuthology.task.install:Using flavor: basic 2021-03-30T04:57:17.030 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-03-30T04:57:17.031 INFO:teuthology.task.install:extra packages: [] 2021-03-30T04:57:17.031 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2021-03-30T04:57:17.070 INFO:teuthology.orchestra.run.smithi197.stdout:RedHatEnterprise 2021-03-30T04:57:17.072 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-30T04:57:17.073 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e4949d651265114d7b464cd1e8986d9a31a26071', 'tag': None, 'wait_for_package': False} 2021-03-30T04:57:17.081 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2021-03-30T04:57:17.151 INFO:teuthology.orchestra.run.smithi197.stdout:RedHatEnterprise 2021-03-30T04:57:17.151 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-30T04:57:17.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e4949d651265114d7b464cd1e8986d9a31a26071 2021-03-30T04:57:17.304 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-sage4-testing-2021-03-29-2018-octopus/e4949d651265114d7b464cd1e8986d9a31a26071/centos/8/flavors/default/ 2021-03-30T04:57:17.304 INFO:teuthology.task.install.rpm:Package version is 15.2.10-14.ge4949d65 2021-03-30T04:57:17.426 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-sage4-testing-2021-03-29-2018-octopus/e4949d651265114d7b464cd1e8986d9a31a26071/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-sage4-testing-2021-03-29-2018-octopus/e4949d651265114d7b464cd1e8986d9a31a26071/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-sage4-testing-2021-03-29-2018-octopus/e4949d651265114d7b464cd1e8986d9a31a26071/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-03-30T04:57:17.427 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-03-30T04:57:17.427 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-03-30T04:57:17.458 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-03-30T04:57:17.458 DEBUG:teuthology.orchestra.run.smithi197:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e4949d651265114d7b464cd1e8986d9a31a26071/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-03-30T04:57:17.525 DEBUG:teuthology.orchestra.run.smithi197:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-03-30T04:57:17.600 DEBUG:teuthology.orchestra.run.smithi197:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-03-30T04:57:17.664 INFO:teuthology.orchestra.run.smithi197.stdout:check_obsoletes = 1 2021-03-30T04:57:17.666 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum clean all 2021-03-30T04:57:18.036 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:57:18.325 INFO:teuthology.orchestra.run.smithi197.stdout:43 files removed 2021-03-30T04:57:18.371 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-radosgw 2021-03-30T04:57:18.703 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:57:19.418 INFO:teuthology.orchestra.run.smithi197.stdout:ceph packages for x86_64 315 kB/s | 69 kB 00:00 2021-03-30T04:57:19.632 INFO:teuthology.orchestra.run.smithi197.stdout:ceph noarch packages 82 kB/s | 15 kB 00:00 2021-03-30T04:57:19.842 INFO:teuthology.orchestra.run.smithi197.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2021-03-30T04:57:20.375 INFO:teuthology.orchestra.run.smithi197.stdout:Extra Packages for Enterprise Linux 18 MB/s | 9.1 MB 00:00 2021-03-30T04:57:22.201 INFO:teuthology.orchestra.run.smithi197.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-03-30T04:57:22.509 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 MB/s | 26 MB 00:00 2021-03-30T04:57:26.633 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 MB/s | 28 MB 00:00 2021-03-30T04:57:33.114 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:57:33.126 INFO:teuthology.orchestra.run.smithi197.stdout:=================================================================================================== 2021-03-30T04:57:33.126 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:57:33.126 INFO:teuthology.orchestra.run.smithi197.stdout:=================================================================================================== 2021-03-30T04:57:33.126 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:57:33.127 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-radosgw x86_64 2:15.2.10-14.ge4949d65.el8 ceph 10 M 2021-03-30T04:57:33.127 INFO:teuthology.orchestra.run.smithi197.stdout:Upgrading: 2021-03-30T04:57:33.127 INFO:teuthology.orchestra.run.smithi197.stdout: librados2 x86_64 2:15.2.10-14.ge4949d65.el8 ceph 3.6 M 2021-03-30T04:57:33.127 INFO:teuthology.orchestra.run.smithi197.stdout: librbd1 x86_64 2:15.2.10-14.ge4949d65.el8 ceph 1.9 M 2021-03-30T04:57:33.128 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:57:33.128 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-base x86_64 2:15.2.10-14.ge4949d65.el8 ceph 5.6 M 2021-03-30T04:57:33.128 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-common x86_64 2:15.2.10-14.ge4949d65.el8 ceph 21 M 2021-03-30T04:57:33.128 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-selinux x86_64 2:15.2.10-14.ge4949d65.el8 ceph 25 k 2021-03-30T04:57:33.128 INFO:teuthology.orchestra.run.smithi197.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-03-30T04:57:33.129 INFO:teuthology.orchestra.run.smithi197.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-03-30T04:57:33.129 INFO:teuthology.orchestra.run.smithi197.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-03-30T04:57:33.129 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs2 x86_64 2:15.2.10-14.ge4949d65.el8 ceph 512 k 2021-03-30T04:57:33.129 INFO:teuthology.orchestra.run.smithi197.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-03-30T04:57:33.130 INFO:teuthology.orchestra.run.smithi197.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-03-30T04:57:33.131 INFO:teuthology.orchestra.run.smithi197.stdout: libradosstriper1 x86_64 2:15.2.10-14.ge4949d65.el8 ceph 384 k 2021-03-30T04:57:33.131 INFO:teuthology.orchestra.run.smithi197.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-03-30T04:57:33.131 INFO:teuthology.orchestra.run.smithi197.stdout: librgw2 x86_64 2:15.2.10-14.ge4949d65.el8 ceph 3.3 M 2021-03-30T04:57:33.131 INFO:teuthology.orchestra.run.smithi197.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-03-30T04:57:33.132 INFO:teuthology.orchestra.run.smithi197.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-03-30T04:57:33.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-argparse x86_64 2:15.2.10-14.ge4949d65.el8 ceph 40 k 2021-03-30T04:57:33.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-common x86_64 2:15.2.10-14.ge4949d65.el8 ceph 76 k 2021-03-30T04:57:33.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cephfs x86_64 2:15.2.10-14.ge4949d65.el8 ceph 164 k 2021-03-30T04:57:33.133 INFO:teuthology.orchestra.run.smithi197.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-03-30T04:57:33.133 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rados x86_64 2:15.2.10-14.ge4949d65.el8 ceph 364 k 2021-03-30T04:57:33.134 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rbd x86_64 2:15.2.10-14.ge4949d65.el8 ceph 350 k 2021-03-30T04:57:33.134 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rgw x86_64 2:15.2.10-14.ge4949d65.el8 ceph 113 k 2021-03-30T04:57:33.134 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:57:33.134 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:57:33.135 INFO:teuthology.orchestra.run.smithi197.stdout:=================================================================================================== 2021-03-30T04:57:33.135 INFO:teuthology.orchestra.run.smithi197.stdout:Install 22 Packages 2021-03-30T04:57:33.135 INFO:teuthology.orchestra.run.smithi197.stdout:Upgrade 2 Packages 2021-03-30T04:57:33.135 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:57:33.136 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 49 M 2021-03-30T04:57:33.136 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:57:33.877 INFO:teuthology.orchestra.run.smithi197.stdout:(1/24): ceph-base-15.2.10-14.ge4949d65.el8.x86_ 7.5 MB/s | 5.6 MB 00:00 2021-03-30T04:57:33.897 INFO:teuthology.orchestra.run.smithi197.stdout:(2/24): ceph-selinux-15.2.10-14.ge4949d65.el8.x 851 kB/s | 25 kB 00:00 2021-03-30T04:57:33.974 INFO:teuthology.orchestra.run.smithi197.stdout:(3/24): libcephfs2-15.2.10-14.ge4949d65.el8.x86 6.5 MB/s | 512 kB 00:00 2021-03-30T04:57:34.021 INFO:teuthology.orchestra.run.smithi197.stdout:(4/24): libradosstriper1-15.2.10-14.ge4949d65.e 8.0 MB/s | 384 kB 00:00 2021-03-30T04:57:34.347 INFO:teuthology.orchestra.run.smithi197.stdout:(5/24): ceph-radosgw-15.2.10-14.ge4949d65.el8.x 8.3 MB/s | 10 MB 00:01 2021-03-30T04:57:34.390 INFO:teuthology.orchestra.run.smithi197.stdout:(6/24): librgw2-15.2.10-14.ge4949d65.el8.x86_64 8.8 MB/s | 3.3 MB 00:00 2021-03-30T04:57:34.391 INFO:teuthology.orchestra.run.smithi197.stdout:(7/24): python3-ceph-argparse-15.2.10-14.ge4949 902 kB/s | 40 kB 00:00 2021-03-30T04:57:34.418 INFO:teuthology.orchestra.run.smithi197.stdout:(8/24): python3-ceph-common-15.2.10-14.ge4949d6 2.7 MB/s | 76 kB 00:00 2021-03-30T04:57:34.424 INFO:teuthology.orchestra.run.smithi197.stdout:(9/24): python3-cephfs-15.2.10-14.ge4949d65.el8 4.9 MB/s | 164 kB 00:00 2021-03-30T04:57:34.463 INFO:teuthology.orchestra.run.smithi197.stdout:(10/24): python3-rados-15.2.10-14.ge4949d65.el8 8.2 MB/s | 364 kB 00:00 2021-03-30T04:57:34.479 INFO:teuthology.orchestra.run.smithi197.stdout:(11/24): python3-rbd-15.2.10-14.ge4949d65.el8.x 6.8 MB/s | 350 kB 00:00 2021-03-30T04:57:34.504 INFO:teuthology.orchestra.run.smithi197.stdout:(12/24): python3-rgw-15.2.10-14.ge4949d65.el8.x 2.6 MB/s | 113 kB 00:00 2021-03-30T04:57:34.608 INFO:teuthology.orchestra.run.smithi197.stdout:(13/24): fmt-6.2.1-1.el8.x86_64.rpm 866 kB/s | 116 kB 00:00 2021-03-30T04:57:34.666 INFO:teuthology.orchestra.run.smithi197.stdout:(14/24): leveldb-1.22-1.el8.x86_64.rpm 3.3 MB/s | 181 kB 00:00 2021-03-30T04:57:34.690 INFO:teuthology.orchestra.run.smithi197.stdout:(15/24): liboath-2.6.2-3.el8.x86_64.rpm 2.1 MB/s | 59 kB 00:00 2021-03-30T04:57:34.718 INFO:teuthology.orchestra.run.smithi197.stdout:(16/24): libunwind-1.3.1-3.el8.x86_64.rpm 2.7 MB/s | 75 kB 00:00 2021-03-30T04:57:34.911 INFO:teuthology.orchestra.run.smithi197.stdout:(17/24): ceph-common-15.2.10-14.ge4949d65.el8.x 12 MB/s | 21 MB 00:01 2021-03-30T04:57:34.913 INFO:teuthology.orchestra.run.smithi197.stdout:(18/24): python3-prettytable-0.7.2-14.el8.noarc 226 kB/s | 44 kB 00:00 2021-03-30T04:57:34.946 INFO:teuthology.orchestra.run.smithi197.stdout:(19/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.9 MB/s | 259 kB 00:00 2021-03-30T04:57:34.959 INFO:teuthology.orchestra.run.smithi197.stdout:(20/24): librdkafka-0.11.4-1.el8.x86_64.rpm 8.0 MB/s | 353 kB 00:00 2021-03-30T04:57:34.968 INFO:teuthology.orchestra.run.smithi197.stdout:(21/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 2.2 MB/s | 47 kB 00:00 2021-03-30T04:57:34.992 INFO:teuthology.orchestra.run.smithi197.stdout:(22/24): gperftools-libs-2.7-9.el8.x86_64.rpm 629 kB/s | 306 kB 00:00 2021-03-30T04:57:35.073 INFO:teuthology.orchestra.run.smithi197.stdout:(23/24): librbd1-15.2.10-14.ge4949d65.el8.x86_6 18 MB/s | 1.9 MB 00:00 2021-03-30T04:57:35.185 INFO:teuthology.orchestra.run.smithi197.stdout:(24/24): librados2-15.2.10-14.ge4949d65.el8.x86 16 MB/s | 3.6 MB 00:00 2021-03-30T04:57:35.188 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:57:35.188 INFO:teuthology.orchestra.run.smithi197.stdout:Total 24 MB/s | 49 MB 00:02 2021-03-30T04:57:35.192 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:57:35.238 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:57:35.238 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:57:35.724 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:57:35.735 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:57:36.863 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:57:37.110 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-03-30T04:57:37.284 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-03-30T04:57:37.717 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-03-30T04:57:37.920 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : librados2-2:15.2.10-14.ge4949d65.el8.x86_64 3/26 2021-03-30T04:57:38.049 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados2-2:15.2.10-14.ge4949d65.el8.x86_64 3/26 2021-03-30T04:57:38.223 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rados-2:15.2.10-14.ge4949d65.el8.x86_64 4/26 2021-03-30T04:57:38.443 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/26 2021-03-30T04:57:38.651 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcephfs2-2:15.2.10-14.ge4949d65.el8.x86_64 6/26 2021-03-30T04:57:38.904 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libcephfs2-2:15.2.10-14.ge4949d65.el8.x86_64 6/26 2021-03-30T04:57:39.143 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : librbd1-2:15.2.10-14.ge4949d65.el8.x86_64 7/26 2021-03-30T04:57:39.240 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librbd1-2:15.2.10-14.ge4949d65.el8.x86_64 7/26 2021-03-30T04:57:39.408 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-03-30T04:57:39.601 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-03-30T04:57:39.940 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-03-30T04:57:40.125 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librgw2-2:15.2.10-14.ge4949d65.el8.x86_64 10/26 2021-03-30T04:57:40.189 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librgw2-2:15.2.10-14.ge4949d65.el8.x86_64 10/26 2021-03-30T04:57:40.348 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-03-30T04:57:40.477 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-ceph-argparse-2:15.2.10-14.ge4949d65.el8.x 12/26 2021-03-30T04:57:40.629 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cephfs-2:15.2.10-14.ge4949d65.el8.x86_64 13/26 2021-03-30T04:57:40.842 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rgw-2:15.2.10-14.ge4949d65.el8.x86_64 14/26 2021-03-30T04:57:41.059 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rbd-2:15.2.10-14.ge4949d65.el8.x86_64 15/26 2021-03-30T04:57:41.208 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libradosstriper1-2:15.2.10-14.ge4949d65.el8.x86_64 16/26 2021-03-30T04:57:41.300 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libradosstriper1-2:15.2.10-14.ge4949d65.el8.x86_64 16/26 2021-03-30T04:57:41.462 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/26 2021-03-30T04:57:41.699 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 18/26 2021-03-30T04:57:41.945 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2021-03-30T04:57:42.092 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-ceph-common-2:15.2.10-14.ge4949d65.el8.x86 20/26 2021-03-30T04:57:45.386 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-common-2:15.2.10-14.ge4949d65.el8.x86_64 21/26 2021-03-30T04:57:45.617 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-common-2:15.2.10-14.ge4949d65.el8.x86_64 21/26 2021-03-30T04:57:46.292 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-common-2:15.2.10-14.ge4949d65.el8.x86_64 21/26 2021-03-30T04:57:46.569 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-base-2:15.2.10-14.ge4949d65.el8.x86_64 22/26 2021-03-30T04:57:46.664 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-base-2:15.2.10-14.ge4949d65.el8.x86_64 22/26 2021-03-30T04:57:46.808 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-selinux-2:15.2.10-14.ge4949d65.el8.x86_64 23/26 2021-03-30T04:58:03.773 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-selinux-2:15.2.10-14.ge4949d65.el8.x86_64 23/26 2021-03-30T04:58:03.774 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /sys 2021-03-30T04:58:03.775 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /proc 2021-03-30T04:58:03.775 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /dev 2021-03-30T04:58:03.775 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /run 2021-03-30T04:58:03.776 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /mnt 2021-03-30T04:58:03.776 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /var/tmp 2021-03-30T04:58:03.776 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /home 2021-03-30T04:58:03.776 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /tmp 2021-03-30T04:58:03.777 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /dev 2021-03-30T04:58:03.777 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:04.847 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-radosgw-2:15.2.10-14.ge4949d65.el8.x86_64 24/26 2021-03-30T04:58:04.926 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-radosgw-2:15.2.10-14.ge4949d65.el8.x86_64 24/26 2021-03-30T04:58:04.926 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-03-30T04:58:05.157 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-03-30T04:58:05.158 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-03-30T04:58:05.953 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-03-30T04:58:05.954 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-base-2:15.2.10-14.ge4949d65.el8.x86_64 1/26 2021-03-30T04:58:05.954 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-common-2:15.2.10-14.ge4949d65.el8.x86_64 2/26 2021-03-30T04:58:05.955 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-radosgw-2:15.2.10-14.ge4949d65.el8.x86_64 3/26 2021-03-30T04:58:05.955 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-selinux-2:15.2.10-14.ge4949d65.el8.x86_64 4/26 2021-03-30T04:58:05.956 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcephfs2-2:15.2.10-14.ge4949d65.el8.x86_64 5/26 2021-03-30T04:58:05.956 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libradosstriper1-2:15.2.10-14.ge4949d65.el8.x86_64 6/26 2021-03-30T04:58:05.957 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librgw2-2:15.2.10-14.ge4949d65.el8.x86_64 7/26 2021-03-30T04:58:05.957 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-ceph-argparse-2:15.2.10-14.ge4949d65.el8.x 8/26 2021-03-30T04:58:05.958 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-ceph-common-2:15.2.10-14.ge4949d65.el8.x86 9/26 2021-03-30T04:58:05.959 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cephfs-2:15.2.10-14.ge4949d65.el8.x86_64 10/26 2021-03-30T04:58:05.959 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rados-2:15.2.10-14.ge4949d65.el8.x86_64 11/26 2021-03-30T04:58:05.960 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rbd-2:15.2.10-14.ge4949d65.el8.x86_64 12/26 2021-03-30T04:58:05.960 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rgw-2:15.2.10-14.ge4949d65.el8.x86_64 13/26 2021-03-30T04:58:05.961 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 14/26 2021-03-30T04:58:05.961 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 15/26 2021-03-30T04:58:05.962 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : leveldb-1.22-1.el8.x86_64 16/26 2021-03-30T04:58:05.962 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/26 2021-03-30T04:58:05.962 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/26 2021-03-30T04:58:05.963 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-03-30T04:58:05.963 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 20/26 2021-03-30T04:58:05.964 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 21/26 2021-03-30T04:58:05.964 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 22/26 2021-03-30T04:58:05.965 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados2-2:15.2.10-14.ge4949d65.el8.x86_64 23/26 2021-03-30T04:58:05.965 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-03-30T04:58:05.965 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librbd1-2:15.2.10-14.ge4949d65.el8.x86_64 25/26 2021-03-30T04:58:06.944 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-03-30T04:58:06.944 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:58:08.946 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:08.947 INFO:teuthology.orchestra.run.smithi197.stdout:Upgraded: 2021-03-30T04:58:08.947 INFO:teuthology.orchestra.run.smithi197.stdout: librados2-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.947 INFO:teuthology.orchestra.run.smithi197.stdout: librbd1-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.948 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:08.948 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:58:08.948 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-base-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.948 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-common-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.948 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-radosgw-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.949 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-selinux-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.949 INFO:teuthology.orchestra.run.smithi197.stdout: fmt-6.2.1-1.el8.x86_64 2021-03-30T04:58:08.949 INFO:teuthology.orchestra.run.smithi197.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-03-30T04:58:08.949 INFO:teuthology.orchestra.run.smithi197.stdout: leveldb-1.22-1.el8.x86_64 2021-03-30T04:58:08.950 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs2-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.950 INFO:teuthology.orchestra.run.smithi197.stdout: liboath-2.6.2-3.el8.x86_64 2021-03-30T04:58:08.950 INFO:teuthology.orchestra.run.smithi197.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-03-30T04:58:08.951 INFO:teuthology.orchestra.run.smithi197.stdout: libradosstriper1-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.951 INFO:teuthology.orchestra.run.smithi197.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-03-30T04:58:08.951 INFO:teuthology.orchestra.run.smithi197.stdout: librgw2-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.952 INFO:teuthology.orchestra.run.smithi197.stdout: libunwind-1.3.1-3.el8.x86_64 2021-03-30T04:58:08.952 INFO:teuthology.orchestra.run.smithi197.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-03-30T04:58:08.953 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-argparse-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.953 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-common-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.953 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cephfs-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.954 INFO:teuthology.orchestra.run.smithi197.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-03-30T04:58:08.955 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rados-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.955 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rbd-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.955 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rgw-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:08.956 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:08.956 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:58:09.057 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-test 2021-03-30T04:58:09.399 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:58:09.865 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-03-30T04:58:09.996 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-03-30T04:58:11.799 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:58:11.802 INFO:teuthology.orchestra.run.smithi197.stdout:======================================================================================== 2021-03-30T04:58:11.802 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:58:11.803 INFO:teuthology.orchestra.run.smithi197.stdout:======================================================================================== 2021-03-30T04:58:11.803 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:58:11.803 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-test x86_64 2:15.2.10-14.ge4949d65.el8 ceph 43 M 2021-03-30T04:58:11.804 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:58:11.804 INFO:teuthology.orchestra.run.smithi197.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-03-30T04:58:11.804 INFO:teuthology.orchestra.run.smithi197.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2021-03-30T04:58:11.804 INFO:teuthology.orchestra.run.smithi197.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-03-30T04:58:11.805 INFO:teuthology.orchestra.run.smithi197.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-03-30T04:58:11.805 INFO:teuthology.orchestra.run.smithi197.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-03-30T04:58:11.805 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:11.805 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:58:11.805 INFO:teuthology.orchestra.run.smithi197.stdout:======================================================================================== 2021-03-30T04:58:11.806 INFO:teuthology.orchestra.run.smithi197.stdout:Install 6 Packages 2021-03-30T04:58:11.806 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:11.806 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 43 M 2021-03-30T04:58:11.807 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 182 M 2021-03-30T04:58:11.807 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:58:11.833 INFO:teuthology.orchestra.run.smithi197.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 5.2 MB/s | 161 kB 00:00 2021-03-30T04:58:11.855 INFO:teuthology.orchestra.run.smithi197.stdout:(2/6): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2021-03-30T04:58:11.880 INFO:teuthology.orchestra.run.smithi197.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.4 MB/s | 187 kB 00:00 2021-03-30T04:58:11.893 INFO:teuthology.orchestra.run.smithi197.stdout:(4/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 762 kB/s | 69 kB 00:00 2021-03-30T04:58:11.900 INFO:teuthology.orchestra.run.smithi197.stdout:(5/6): libxslt-1.1.32-5.el8.x86_64.rpm 12 MB/s | 250 kB 00:00 2021-03-30T04:58:14.447 INFO:teuthology.orchestra.run.smithi197.stdout:(6/6): ceph-test-15.2.10-14.ge4949d65.el8.x86_6 16 MB/s | 43 MB 00:02 2021-03-30T04:58:14.449 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:58:14.450 INFO:teuthology.orchestra.run.smithi197.stdout:Total 16 MB/s | 43 MB 00:02 2021-03-30T04:58:14.454 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:58:14.478 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:58:14.479 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:58:14.722 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:58:14.726 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:58:15.203 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:58:15.452 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/6 2021-03-30T04:58:15.615 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-03-30T04:58:15.778 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2021-03-30T04:58:15.861 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2021-03-30T04:58:16.091 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : jq-1.5-12.el8.x86_64 4/6 2021-03-30T04:58:20.159 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 5/6 2021-03-30T04:58:20.392 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-test-2:15.2.10-14.ge4949d65.el8.x86_64 6/6 2021-03-30T04:58:20.631 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-test-2:15.2.10-14.ge4949d65.el8.x86_64 6/6 2021-03-30T04:58:20.632 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-test-2:15.2.10-14.ge4949d65.el8.x86_64 1/6 2021-03-30T04:58:20.632 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-03-30T04:58:20.633 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : jq-1.5-12.el8.x86_64 3/6 2021-03-30T04:58:20.633 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/6 2021-03-30T04:58:20.633 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2021-03-30T04:58:20.988 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 6/6 2021-03-30T04:58:20.988 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:58:23.077 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:23.077 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:58:23.077 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-test-2:15.2.10-14.ge4949d65.el8.x86_64 jq-1.5-12.el8.x86_64 2021-03-30T04:58:23.078 INFO:teuthology.orchestra.run.smithi197.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-03-30T04:58:23.078 INFO:teuthology.orchestra.run.smithi197.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-03-30T04:58:23.078 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:23.078 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:58:23.170 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph 2021-03-30T04:58:23.505 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:58:23.971 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 99 kB/s | 2.8 kB 00:00 2021-03-30T04:58:24.102 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 86 kB/s | 2.4 kB 00:00 2021-03-30T04:58:25.627 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:58:25.631 INFO:teuthology.orchestra.run.smithi197.stdout:====================================================================================================== 2021-03-30T04:58:25.632 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:58:25.632 INFO:teuthology.orchestra.run.smithi197.stdout:====================================================================================================== 2021-03-30T04:58:25.633 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:58:25.633 INFO:teuthology.orchestra.run.smithi197.stdout: ceph x86_64 2:15.2.10-14.ge4949d65.el8 ceph 6.4 k 2021-03-30T04:58:25.633 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:58:25.634 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mds x86_64 2:15.2.10-14.ge4949d65.el8 ceph 2.0 M 2021-03-30T04:58:25.634 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr x86_64 2:15.2.10-14.ge4949d65.el8 ceph 1.4 M 2021-03-30T04:58:25.635 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-modules-core noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 192 k 2021-03-30T04:58:25.637 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon x86_64 2:15.2.10-14.ge4949d65.el8 ceph 4.4 M 2021-03-30T04:58:25.637 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-osd x86_64 2:15.2.10-14.ge4949d65.el8 ceph 17 M 2021-03-30T04:58:25.638 INFO:teuthology.orchestra.run.smithi197.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-03-30T04:58:25.638 INFO:teuthology.orchestra.run.smithi197.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-03-30T04:58:25.638 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-03-30T04:58:25.639 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-03-30T04:58:25.639 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-03-30T04:58:25.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-03-30T04:58:25.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-03-30T04:58:25.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2021-03-30T04:58:25.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-03-30T04:58:25.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-03-30T04:58:25.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-03-30T04:58:25.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-03-30T04:58:25.643 INFO:teuthology.orchestra.run.smithi197.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-03-30T04:58:25.643 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-03-30T04:58:25.644 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-03-30T04:58:25.644 INFO:teuthology.orchestra.run.smithi197.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-03-30T04:58:25.644 INFO:teuthology.orchestra.run.smithi197.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-03-30T04:58:25.645 INFO:teuthology.orchestra.run.smithi197.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-03-30T04:58:25.645 INFO:teuthology.orchestra.run.smithi197.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-03-30T04:58:25.646 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-03-30T04:58:25.646 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-03-30T04:58:25.647 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-03-30T04:58:25.647 INFO:teuthology.orchestra.run.smithi197.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-03-30T04:58:25.647 INFO:teuthology.orchestra.run.smithi197.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-03-30T04:58:25.648 INFO:teuthology.orchestra.run.smithi197.stdout:Installing weak dependencies: 2021-03-30T04:58:25.648 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-03-30T04:58:25.649 INFO:teuthology.orchestra.run.smithi197.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2021-03-30T04:58:25.649 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:25.650 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:58:25.650 INFO:teuthology.orchestra.run.smithi197.stdout:====================================================================================================== 2021-03-30T04:58:25.650 INFO:teuthology.orchestra.run.smithi197.stdout:Install 32 Packages 2021-03-30T04:58:25.651 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:25.652 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 29 M 2021-03-30T04:58:25.654 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 102 M 2021-03-30T04:58:25.655 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:58:25.737 INFO:teuthology.orchestra.run.smithi197.stdout:(1/32): ceph-15.2.10-14.ge4949d65.el8.x86_64.rp 64 kB/s | 6.4 kB 00:00 2021-03-30T04:58:25.923 INFO:teuthology.orchestra.run.smithi197.stdout:(2/32): ceph-mgr-15.2.10-14.ge4949d65.el8.x86_6 5.0 MB/s | 1.4 MB 00:00 2021-03-30T04:58:25.948 INFO:teuthology.orchestra.run.smithi197.stdout:(3/32): ceph-mds-15.2.10-14.ge4949d65.el8.x86_6 6.5 MB/s | 2.0 MB 00:00 2021-03-30T04:58:25.991 INFO:teuthology.orchestra.run.smithi197.stdout:(4/32): ceph-mgr-modules-core-15.2.10-14.ge4949 4.4 MB/s | 192 kB 00:00 2021-03-30T04:58:26.098 INFO:teuthology.orchestra.run.smithi197.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 407 kB/s | 44 kB 00:00 2021-03-30T04:58:26.180 INFO:teuthology.orchestra.run.smithi197.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 2.2 MB/s | 185 kB 00:00 2021-03-30T04:58:26.192 INFO:teuthology.orchestra.run.smithi197.stdout:(7/32): ceph-mon-15.2.10-14.ge4949d65.el8.x86_6 9.6 MB/s | 4.4 MB 00:00 2021-03-30T04:58:26.210 INFO:teuthology.orchestra.run.smithi197.stdout:(8/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 5.7 MB/s | 173 kB 00:00 2021-03-30T04:58:26.238 INFO:teuthology.orchestra.run.smithi197.stdout:(9/32): python3-cssselect-0.9.2-10.el8.noarch.r 1.4 MB/s | 40 kB 00:00 2021-03-30T04:58:26.264 INFO:teuthology.orchestra.run.smithi197.stdout:(10/32): python3-jaraco-6.2-6.el8.noarch.rpm 416 kB/s | 11 kB 00:00 2021-03-30T04:58:26.292 INFO:teuthology.orchestra.run.smithi197.stdout:(11/32): python3-jaraco-functools-2.0-4.el8.noa 650 kB/s | 18 kB 00:00 2021-03-30T04:58:26.319 INFO:teuthology.orchestra.run.smithi197.stdout:(12/32): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-03-30T04:58:26.346 INFO:teuthology.orchestra.run.smithi197.stdout:(13/32): python3-more-itertools-7.2.0-3.el8.noa 2.1 MB/s | 59 kB 00:00 2021-03-30T04:58:26.358 INFO:teuthology.orchestra.run.smithi197.stdout:(14/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.3 MB/s | 384 kB 00:00 2021-03-30T04:58:26.377 INFO:teuthology.orchestra.run.smithi197.stdout:(15/32): python3-pecan-1.3.2-9.el8.noarch.rpm 9.1 MB/s | 283 kB 00:00 2021-03-30T04:58:26.383 INFO:teuthology.orchestra.run.smithi197.stdout:(16/32): python3-portend-2.6-1.el8.noarch.rpm 566 kB/s | 16 kB 00:00 2021-03-30T04:58:26.404 INFO:teuthology.orchestra.run.smithi197.stdout:(17/32): python3-simplegeneric-0.8.1-17.el8.noa 696 kB/s | 19 kB 00:00 2021-03-30T04:58:26.410 INFO:teuthology.orchestra.run.smithi197.stdout:(18/32): python3-singledispatch-3.4.0.3-18.el8. 883 kB/s | 24 kB 00:00 2021-03-30T04:58:26.434 INFO:teuthology.orchestra.run.smithi197.stdout:(19/32): python3-tempora-1.14.1-5.el8.noarch.rp 1.1 MB/s | 29 kB 00:00 2021-03-30T04:58:26.438 INFO:teuthology.orchestra.run.smithi197.stdout:(20/32): python3-trustme-0.6.0-4.el8.noarch.rpm 1.0 MB/s | 27 kB 00:00 2021-03-30T04:58:26.462 INFO:teuthology.orchestra.run.smithi197.stdout:(21/32): python3-waitress-1.2.1-2.el8.1.noarch. 7.7 MB/s | 241 kB 00:00 2021-03-30T04:58:26.471 INFO:teuthology.orchestra.run.smithi197.stdout:(22/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 8.1 MB/s | 251 kB 00:00 2021-03-30T04:58:26.491 INFO:teuthology.orchestra.run.smithi197.stdout:(23/32): python3-webtest-2.0.33-1.el8.noarch.rp 3.0 MB/s | 85 kB 00:00 2021-03-30T04:58:26.499 INFO:teuthology.orchestra.run.smithi197.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 738 kB/s | 23 kB 00:00 2021-03-30T04:58:26.530 INFO:teuthology.orchestra.run.smithi197.stdout:(25/32): python3-webencodings-0.5.1-6.el8.noarc 673 kB/s | 27 kB 00:00 2021-03-30T04:58:26.552 INFO:teuthology.orchestra.run.smithi197.stdout:(26/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 29 MB/s | 1.5 MB 00:00 2021-03-30T04:58:26.561 INFO:teuthology.orchestra.run.smithi197.stdout:(27/32): python3-werkzeug-0.12.2-4.el8.noarch.r 15 MB/s | 457 kB 00:00 2021-03-30T04:58:26.581 INFO:teuthology.orchestra.run.smithi197.stdout:(28/32): python3-mako-1.0.6-13.el8.noarch.rpm 5.8 MB/s | 157 kB 00:00 2021-03-30T04:58:26.588 INFO:teuthology.orchestra.run.smithi197.stdout:(29/32): python3-html5lib-0.999999999-6.el8.noa 7.4 MB/s | 214 kB 00:00 2021-03-30T04:58:26.600 INFO:teuthology.orchestra.run.smithi197.stdout:(30/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.5 MB/s | 54 kB 00:00 2021-03-30T04:58:26.613 INFO:teuthology.orchestra.run.smithi197.stdout:(31/32): python3-markupsafe-0.23-19.el8.x86_64. 1.6 MB/s | 39 kB 00:00 2021-03-30T04:58:26.741 INFO:teuthology.orchestra.run.smithi197.stdout:(32/32): ceph-osd-15.2.10-14.ge4949d65.el8.x86_ 20 MB/s | 17 MB 00:00 2021-03-30T04:58:26.745 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:58:26.746 INFO:teuthology.orchestra.run.smithi197.stdout:Total 26 MB/s | 29 MB 00:01 2021-03-30T04:58:26.751 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:58:26.791 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:58:26.792 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:58:27.113 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:58:27.117 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:58:28.599 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:58:28.822 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2021-03-30T04:58:29.048 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2021-03-30T04:58:29.328 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 3/32 2021-03-30T04:58:29.552 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 4/32 2021-03-30T04:58:29.851 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 5/32 2021-03-30T04:58:30.130 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/32 2021-03-30T04:58:30.384 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 7/32 2021-03-30T04:58:30.610 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 8/32 2021-03-30T04:58:30.829 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 9/32 2021-03-30T04:58:31.018 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 10/32 2021-03-30T04:58:31.219 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 11/32 2021-03-30T04:58:31.381 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 12/32 2021-03-30T04:58:31.605 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 13/32 2021-03-30T04:58:31.778 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 14/32 2021-03-30T04:58:31.924 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 15/32 2021-03-30T04:58:32.208 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 16/32 2021-03-30T04:58:32.430 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2021-03-30T04:58:32.590 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 18/32 2021-03-30T04:58:32.896 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-portend-2.6-1.el8.noarch 19/32 2021-03-30T04:58:33.155 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 20/32 2021-03-30T04:58:33.507 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 21/32 2021-03-30T04:58:33.801 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/32 2021-03-30T04:58:34.053 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 23/32 2021-03-30T04:58:34.377 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 24/32 2021-03-30T04:58:34.629 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 25/32 2021-03-30T04:58:34.913 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 26/32 2021-03-30T04:58:35.247 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-modules-core-2:15.2.10-14.ge4949d65.el8.n 27/32 2021-03-30T04:58:35.394 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-2:15.2.10-14.ge4949d65.el8.x86_64 28/32 2021-03-30T04:58:36.818 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-2:15.2.10-14.ge4949d65.el8.x86_64 28/32 2021-03-30T04:58:37.035 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-osd-2:15.2.10-14.ge4949d65.el8.x86_64 29/32 2021-03-30T04:58:37.434 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-osd-2:15.2.10-14.ge4949d65.el8.x86_64 29/32 2021-03-30T04:58:37.610 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mon-2:15.2.10-14.ge4949d65.el8.x86_64 30/32 2021-03-30T04:58:37.804 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mon-2:15.2.10-14.ge4949d65.el8.x86_64 30/32 2021-03-30T04:58:37.983 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mds-2:15.2.10-14.ge4949d65.el8.x86_64 31/32 2021-03-30T04:58:38.003 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mds-2:15.2.10-14.ge4949d65.el8.x86_64 31/32 2021-03-30T04:58:38.107 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-2:15.2.10-14.ge4949d65.el8.x86_64 32/32 2021-03-30T04:58:38.458 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-2:15.2.10-14.ge4949d65.el8.x86_64 32/32 2021-03-30T04:58:38.459 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-2:15.2.10-14.ge4949d65.el8.x86_64 1/32 2021-03-30T04:58:38.459 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mds-2:15.2.10-14.ge4949d65.el8.x86_64 2/32 2021-03-30T04:58:38.459 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-2:15.2.10-14.ge4949d65.el8.x86_64 3/32 2021-03-30T04:58:38.459 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mon-2:15.2.10-14.ge4949d65.el8.x86_64 4/32 2021-03-30T04:58:38.460 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-osd-2:15.2.10-14.ge4949d65.el8.x86_64 5/32 2021-03-30T04:58:38.460 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-modules-core-2:15.2.10-14.ge4949d65.el8.n 6/32 2021-03-30T04:58:38.460 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2021-03-30T04:58:38.460 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2021-03-30T04:58:38.460 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2021-03-30T04:58:38.461 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2021-03-30T04:58:38.461 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 11/32 2021-03-30T04:58:38.461 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 12/32 2021-03-30T04:58:38.462 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 13/32 2021-03-30T04:58:38.462 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 14/32 2021-03-30T04:58:38.462 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 15/32 2021-03-30T04:58:38.462 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 16/32 2021-03-30T04:58:38.463 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-portend-2.6-1.el8.noarch 17/32 2021-03-30T04:58:38.463 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 18/32 2021-03-30T04:58:38.463 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 19/32 2021-03-30T04:58:38.463 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 20/32 2021-03-30T04:58:38.464 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 21/32 2021-03-30T04:58:38.464 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/32 2021-03-30T04:58:38.464 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/32 2021-03-30T04:58:38.464 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/32 2021-03-30T04:58:38.464 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 25/32 2021-03-30T04:58:38.465 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 26/32 2021-03-30T04:58:38.465 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 27/32 2021-03-30T04:58:38.465 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2021-03-30T04:58:38.465 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 29/32 2021-03-30T04:58:38.465 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 30/32 2021-03-30T04:58:38.466 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 31/32 2021-03-30T04:58:39.658 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 32/32 2021-03-30T04:58:39.659 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:58:41.737 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:41.737 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:58:41.737 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:41.737 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mds-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:41.738 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:41.738 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-modules-core-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:58:41.738 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:41.738 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-osd-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:41.739 INFO:teuthology.orchestra.run.smithi197.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-03-30T04:58:41.739 INFO:teuthology.orchestra.run.smithi197.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-03-30T04:58:41.739 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-03-30T04:58:41.739 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-03-30T04:58:41.739 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-03-30T04:58:41.740 INFO:teuthology.orchestra.run.smithi197.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-03-30T04:58:41.740 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-6.2-6.el8.noarch 2021-03-30T04:58:41.740 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-03-30T04:58:41.740 INFO:teuthology.orchestra.run.smithi197.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-03-30T04:58:41.741 INFO:teuthology.orchestra.run.smithi197.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-03-30T04:58:41.741 INFO:teuthology.orchestra.run.smithi197.stdout: python3-mako-1.0.6-13.el8.noarch 2021-03-30T04:58:41.741 INFO:teuthology.orchestra.run.smithi197.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-03-30T04:58:41.741 INFO:teuthology.orchestra.run.smithi197.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-03-30T04:58:41.741 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-03-30T04:58:41.742 INFO:teuthology.orchestra.run.smithi197.stdout: python3-portend-2.6-1.el8.noarch 2021-03-30T04:58:41.742 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pytz-2017.2-9.el8.noarch 2021-03-30T04:58:41.742 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-03-30T04:58:41.742 INFO:teuthology.orchestra.run.smithi197.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-03-30T04:58:41.742 INFO:teuthology.orchestra.run.smithi197.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-03-30T04:58:41.743 INFO:teuthology.orchestra.run.smithi197.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-03-30T04:58:41.743 INFO:teuthology.orchestra.run.smithi197.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-03-30T04:58:41.743 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-03-30T04:58:41.743 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-03-30T04:58:41.743 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-03-30T04:58:41.744 INFO:teuthology.orchestra.run.smithi197.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-03-30T04:58:41.744 INFO:teuthology.orchestra.run.smithi197.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-03-30T04:58:41.744 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:41.744 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:58:41.823 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-base 2021-03-30T04:58:42.174 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:58:42.649 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 99 kB/s | 2.8 kB 00:00 2021-03-30T04:58:42.778 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-03-30T04:58:43.961 INFO:teuthology.orchestra.run.smithi197.stdout:Package ceph-base-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T04:58:44.290 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:58:44.292 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T04:58:44.293 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:58:44.364 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install cephadm 2021-03-30T04:58:44.709 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:58:45.197 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-03-30T04:58:45.327 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-03-30T04:58:46.853 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:58:46.853 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:58:46.854 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:58:46.854 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:58:46.854 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:58:46.854 INFO:teuthology.orchestra.run.smithi197.stdout: cephadm noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 58 k 2021-03-30T04:58:46.855 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:46.855 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:58:46.855 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:58:46.856 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2021-03-30T04:58:46.856 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:46.857 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 58 k 2021-03-30T04:58:46.857 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 220 k 2021-03-30T04:58:46.857 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:58:47.264 INFO:teuthology.orchestra.run.smithi197.stdout:cephadm-15.2.10-14.ge4949d65.el8.noarch.rpm 141 kB/s | 58 kB 00:00 2021-03-30T04:58:47.265 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:58:47.265 INFO:teuthology.orchestra.run.smithi197.stdout:Total 141 kB/s | 58 kB 00:00 2021-03-30T04:58:47.265 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:58:47.271 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:58:47.272 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:58:47.273 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:58:47.278 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:58:47.330 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:58:48.866 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: cephadm-2:15.2.10-14.ge4949d65.el8.noarch 1/1 2021-03-30T04:58:49.038 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : cephadm-2:15.2.10-14.ge4949d65.el8.noarch 1/1 2021-03-30T04:58:49.216 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: cephadm-2:15.2.10-14.ge4949d65.el8.noarch 1/1 2021-03-30T04:58:49.763 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : cephadm-2:15.2.10-14.ge4949d65.el8.noarch 1/1 2021-03-30T04:58:49.763 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:58:52.560 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:52.560 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:58:52.560 INFO:teuthology.orchestra.run.smithi197.stdout: cephadm-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:58:52.560 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:52.561 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:58:52.649 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-immutable-object-cache 2021-03-30T04:58:53.007 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:58:53.576 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-03-30T04:58:53.709 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 74 kB/s | 2.4 kB 00:00 2021-03-30T04:58:55.246 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:58:55.247 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:58:55.247 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2021-03-30T04:58:55.247 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:58:55.247 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:58:55.248 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-immutable-object-cache x86_64 2:15.2.10-14.ge4949d65.el8 ceph 205 k 2021-03-30T04:58:55.248 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:55.248 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:58:55.248 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:58:55.249 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2021-03-30T04:58:55.249 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:55.249 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 205 k 2021-03-30T04:58:55.249 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 725 k 2021-03-30T04:58:55.249 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:58:55.417 INFO:teuthology.orchestra.run.smithi197.stdout:ceph-immutable-object-cache-15.2.10-14.ge4949d6 1.2 MB/s | 205 kB 00:00 2021-03-30T04:58:55.418 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:58:55.419 INFO:teuthology.orchestra.run.smithi197.stdout:Total 1.2 MB/s | 205 kB 00:00 2021-03-30T04:58:55.419 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:58:55.432 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:58:55.433 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:58:55.485 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:58:55.489 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:58:55.615 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:58:55.789 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-immutable-object-cache-2:15.2.10-14.ge4949d65.e 1/1 2021-03-30T04:58:56.173 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.10-14.ge4949d65.e 1/1 2021-03-30T04:58:56.419 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-immutable-object-cache-2:15.2.10-14.ge4949d65.e 1/1 2021-03-30T04:58:56.419 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:58:58.512 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:58.512 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:58:58.512 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-immutable-object-cache-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:58:58.513 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:58:58.513 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:58:58.604 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr 2021-03-30T04:58:58.952 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:58:59.432 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-03-30T04:58:59.565 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-03-30T04:59:00.750 INFO:teuthology.orchestra.run.smithi197.stdout:Package ceph-mgr-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T04:59:01.077 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:01.079 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T04:59:01.080 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:01.162 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-dashboard 2021-03-30T04:59:01.507 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:01.980 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-03-30T04:59:02.109 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-03-30T04:59:03.603 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:03.605 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================================== 2021-03-30T04:59:03.605 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:59:03.606 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================================== 2021-03-30T04:59:03.606 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:59:03.606 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-dashboard noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 3.6 M 2021-03-30T04:59:03.607 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:59:03.607 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-grafana-dashboards noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 24 k 2021-03-30T04:59:03.608 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-prometheus-alerts noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 9.0 k 2021-03-30T04:59:03.608 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-03-30T04:59:03.608 INFO:teuthology.orchestra.run.smithi197.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-03-30T04:59:03.609 INFO:teuthology.orchestra.run.smithi197.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-03-30T04:59:03.609 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:03.609 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:59:03.610 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================================== 2021-03-30T04:59:03.610 INFO:teuthology.orchestra.run.smithi197.stdout:Install 6 Packages 2021-03-30T04:59:03.610 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:03.611 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 3.9 M 2021-03-30T04:59:03.611 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 19 M 2021-03-30T04:59:03.611 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:59:03.708 INFO:teuthology.orchestra.run.smithi197.stdout:(1/6): ceph-prometheus-alerts-15.2.10-14.ge4949 89 kB/s | 9.0 kB 00:00 2021-03-30T04:59:03.716 INFO:teuthology.orchestra.run.smithi197.stdout:(2/6): ceph-grafana-dashboards-15.2.10-14.ge494 219 kB/s | 24 kB 00:00 2021-03-30T04:59:03.775 INFO:teuthology.orchestra.run.smithi197.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 497 kB/s | 34 kB 00:00 2021-03-30T04:59:03.807 INFO:teuthology.orchestra.run.smithi197.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-03-30T04:59:03.828 INFO:teuthology.orchestra.run.smithi197.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.7 MB/s | 196 kB 00:00 2021-03-30T04:59:04.157 INFO:teuthology.orchestra.run.smithi197.stdout:(6/6): ceph-mgr-dashboard-15.2.10-14.ge4949d65. 6.5 MB/s | 3.6 MB 00:00 2021-03-30T04:59:04.159 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:59:04.160 INFO:teuthology.orchestra.run.smithi197.stdout:Total 7.0 MB/s | 3.9 MB 00:00 2021-03-30T04:59:04.163 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:59:04.171 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:59:04.171 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:59:04.302 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:59:04.306 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:59:04.626 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:59:04.858 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2021-03-30T04:59:05.048 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2021-03-30T04:59:05.248 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2021-03-30T04:59:05.353 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-prometheus-alerts-2:15.2.10-14.ge4949d65.el8.no 4/6 2021-03-30T04:59:06.497 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-grafana-dashboards-2:15.2.10-14.ge4949d65.el8.n 5/6 2021-03-30T04:59:06.747 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-dashboard-2:15.2.10-14.ge4949d65.el8.noarch 6/6 2021-03-30T04:59:06.983 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.10-14.ge4949d65.el8.noarch 6/6 2021-03-30T04:59:06.983 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-grafana-dashboards-2:15.2.10-14.ge4949d65.el8.n 1/6 2021-03-30T04:59:06.983 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-dashboard-2:15.2.10-14.ge4949d65.el8.noarch 2/6 2021-03-30T04:59:06.984 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-prometheus-alerts-2:15.2.10-14.ge4949d65.el8.no 3/6 2021-03-30T04:59:06.984 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2021-03-30T04:59:06.984 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2021-03-30T04:59:07.265 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2021-03-30T04:59:07.265 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:59:09.833 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:09.833 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:59:09.834 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-grafana-dashboards-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:59:09.834 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-dashboard-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:59:09.835 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-prometheus-alerts-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:59:09.835 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-03-30T04:59:09.835 INFO:teuthology.orchestra.run.smithi197.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-03-30T04:59:09.836 INFO:teuthology.orchestra.run.smithi197.stdout: python3-routes-2.4.1-12.el8.noarch 2021-03-30T04:59:09.836 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:09.838 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:09.929 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-diskprediction-local 2021-03-30T04:59:10.278 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:10.761 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-03-30T04:59:10.891 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-03-30T04:59:12.404 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:12.405 INFO:teuthology.orchestra.run.smithi197.stdout:====================================================================================================================== 2021-03-30T04:59:12.405 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:59:12.405 INFO:teuthology.orchestra.run.smithi197.stdout:====================================================================================================================== 2021-03-30T04:59:12.406 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:59:12.406 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 8.6 M 2021-03-30T04:59:12.406 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:59:12.406 INFO:teuthology.orchestra.run.smithi197.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-03-30T04:59:12.406 INFO:teuthology.orchestra.run.smithi197.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-03-30T04:59:12.407 INFO:teuthology.orchestra.run.smithi197.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2021-03-30T04:59:12.407 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2021-03-30T04:59:12.407 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-03-30T04:59:12.407 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-03-30T04:59:12.407 INFO:teuthology.orchestra.run.smithi197.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-03-30T04:59:12.408 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:12.408 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:59:12.408 INFO:teuthology.orchestra.run.smithi197.stdout:====================================================================================================================== 2021-03-30T04:59:12.408 INFO:teuthology.orchestra.run.smithi197.stdout:Install 8 Packages 2021-03-30T04:59:12.409 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:12.409 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 37 M 2021-03-30T04:59:12.410 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 196 M 2021-03-30T04:59:12.410 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:59:12.455 INFO:teuthology.orchestra.run.smithi197.stdout:(1/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 4.6 MB/s | 225 kB 00:00 2021-03-30T04:59:12.508 INFO:teuthology.orchestra.run.smithi197.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 71 MB/s | 3.7 MB 00:00 2021-03-30T04:59:12.648 INFO:teuthology.orchestra.run.smithi197.stdout:(3/8): python3-scipy-1.0.0-20.module+el8.1.0+33 60 MB/s | 15 MB 00:00 2021-03-30T04:59:12.673 INFO:teuthology.orchestra.run.smithi197.stdout:(4/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2021-03-30T04:59:12.694 INFO:teuthology.orchestra.run.smithi197.stdout:(5/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 8.1 MB/s | 169 kB 00:00 2021-03-30T04:59:12.719 INFO:teuthology.orchestra.run.smithi197.stdout:(6/8): openblas-0.3.3-5.el8.x86_64.rpm 61 MB/s | 4.3 MB 00:00 2021-03-30T04:59:12.723 INFO:teuthology.orchestra.run.smithi197.stdout:(7/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 22 MB/s | 639 kB 00:00 2021-03-30T04:59:13.328 INFO:teuthology.orchestra.run.smithi197.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.10-14 9.3 MB/s | 8.6 MB 00:00 2021-03-30T04:59:13.330 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:59:13.330 INFO:teuthology.orchestra.run.smithi197.stdout:Total 40 MB/s | 37 MB 00:00 2021-03-30T04:59:13.339 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:59:13.360 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:59:13.361 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:59:13.702 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:59:13.707 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:59:14.278 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:59:14.436 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-03-30T04:59:14.599 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-03-30T04:59:14.777 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-03-30T04:59:15.319 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-03-30T04:59:15.502 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-03-30T04:59:16.010 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-03-30T04:59:16.210 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : openblas-0.3.3-5.el8.x86_64 4/8 2021-03-30T04:59:16.946 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 4/8 2021-03-30T04:59:17.306 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-03-30T04:59:17.543 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-03-30T04:59:19.592 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-03-30T04:59:20.923 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2021-03-30T04:59:21.059 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.10-14.ge4949d65 8/8 2021-03-30T04:59:21.342 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.10-14.ge4949d65 8/8 2021-03-30T04:59:21.342 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.10-14.ge4949d65 1/8 2021-03-30T04:59:21.343 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 2/8 2021-03-30T04:59:21.343 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 3/8 2021-03-30T04:59:21.344 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-03-30T04:59:21.344 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 5/8 2021-03-30T04:59:21.345 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 6/8 2021-03-30T04:59:21.345 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 7/8 2021-03-30T04:59:21.642 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 8/8 2021-03-30T04:59:21.642 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:59:23.663 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:23.663 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:59:23.664 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:59:23.664 INFO:teuthology.orchestra.run.smithi197.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-03-30T04:59:23.664 INFO:teuthology.orchestra.run.smithi197.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-03-30T04:59:23.664 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-0.3.3-5.el8.x86_64 2021-03-30T04:59:23.664 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-03-30T04:59:23.665 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-03-30T04:59:23.665 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-03-30T04:59:23.665 INFO:teuthology.orchestra.run.smithi197.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-03-30T04:59:23.665 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:23.666 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:23.827 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-rook 2021-03-30T04:59:24.175 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:24.649 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-03-30T04:59:24.778 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 79 kB/s | 2.4 kB 00:00 2021-03-30T04:59:26.274 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:26.276 INFO:teuthology.orchestra.run.smithi197.stdout:======================================================================================================= 2021-03-30T04:59:26.276 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:59:26.276 INFO:teuthology.orchestra.run.smithi197.stdout:======================================================================================================= 2021-03-30T04:59:26.276 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:59:26.277 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-rook noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 27 k 2021-03-30T04:59:26.277 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:59:26.277 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-03-30T04:59:26.277 INFO:teuthology.orchestra.run.smithi197.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-03-30T04:59:26.277 INFO:teuthology.orchestra.run.smithi197.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-03-30T04:59:26.278 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-03-30T04:59:26.278 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-03-30T04:59:26.278 INFO:teuthology.orchestra.run.smithi197.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-03-30T04:59:26.278 INFO:teuthology.orchestra.run.smithi197.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-03-30T04:59:26.279 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-03-30T04:59:26.279 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-03-30T04:59:26.279 INFO:teuthology.orchestra.run.smithi197.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-03-30T04:59:26.279 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-03-30T04:59:26.280 INFO:teuthology.orchestra.run.smithi197.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-03-30T04:59:26.280 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:26.280 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:59:26.280 INFO:teuthology.orchestra.run.smithi197.stdout:======================================================================================================= 2021-03-30T04:59:26.280 INFO:teuthology.orchestra.run.smithi197.stdout:Install 13 Packages 2021-03-30T04:59:26.281 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:26.281 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 1.9 M 2021-03-30T04:59:26.282 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 24 M 2021-03-30T04:59:26.283 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:59:26.350 INFO:teuthology.orchestra.run.smithi197.stdout:(1/13): python3-cachetools-3.1.1-4.el8.noarch.r 463 kB/s | 33 kB 00:00 2021-03-30T04:59:26.391 INFO:teuthology.orchestra.run.smithi197.stdout:(2/13): ceph-mgr-rook-15.2.10-14.ge4949d65.el8. 243 kB/s | 27 kB 00:00 2021-03-30T04:59:26.394 INFO:teuthology.orchestra.run.smithi197.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 1.8 MB/s | 81 kB 00:00 2021-03-30T04:59:26.395 INFO:teuthology.orchestra.run.smithi197.stdout:(4/13): python3-certifi-2018.10.15-7.el8.noarch 141 kB/s | 16 kB 00:00 2021-03-30T04:59:26.417 INFO:teuthology.orchestra.run.smithi197.stdout:(5/13): python3-rsa-3.4.2-16.el8.noarch.rpm 3.2 MB/s | 73 kB 00:00 2021-03-30T04:59:26.440 INFO:teuthology.orchestra.run.smithi197.stdout:(6/13): python3-websocket-client-0.56.0-5.el8.n 1.3 MB/s | 61 kB 00:00 2021-03-30T04:59:26.448 INFO:teuthology.orchestra.run.smithi197.stdout:(7/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 850 kB/s | 27 kB 00:00 2021-03-30T04:59:26.474 INFO:teuthology.orchestra.run.smithi197.stdout:(8/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.1 MB/s | 126 kB 00:00 2021-03-30T04:59:26.479 INFO:teuthology.orchestra.run.smithi197.stdout:(9/13): python3-jsonpointer-1.10-11.el8.noarch. 513 kB/s | 20 kB 00:00 2021-03-30T04:59:26.493 INFO:teuthology.orchestra.run.smithi197.stdout:(10/13): python3-pyasn1-modules-0.3.7-6.el8.noa 5.4 MB/s | 110 kB 00:00 2021-03-30T04:59:26.504 INFO:teuthology.orchestra.run.smithi197.stdout:(11/13): python3-requests-oauthlib-1.0.0-1.el8. 1.7 MB/s | 43 kB 00:00 2021-03-30T04:59:26.517 INFO:teuthology.orchestra.run.smithi197.stdout:(12/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 7.4 MB/s | 155 kB 00:00 2021-03-30T04:59:27.111 INFO:teuthology.orchestra.run.smithi197.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.6 MB/s | 1.2 MB 00:00 2021-03-30T04:59:27.112 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:59:27.113 INFO:teuthology.orchestra.run.smithi197.stdout:Total 2.3 MB/s | 1.9 MB 00:00 2021-03-30T04:59:27.117 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:59:27.133 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:59:27.133 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:59:27.219 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:59:27.223 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:59:27.722 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:59:27.960 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-03-30T04:59:28.199 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 2/13 2021-03-30T04:59:28.435 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2021-03-30T04:59:28.675 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2021-03-30T04:59:28.882 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2021-03-30T04:59:29.083 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2021-03-30T04:59:29.340 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2021-03-30T04:59:29.551 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2021-03-30T04:59:29.795 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-03-30T04:59:30.067 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2021-03-30T04:59:31.283 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2021-03-30T04:59:31.575 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2021-03-30T04:59:31.719 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-rook-2:15.2.10-14.ge4949d65.el8.noarch 13/13 2021-03-30T04:59:31.975 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.10-14.ge4949d65.el8.noarch 13/13 2021-03-30T04:59:31.976 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-rook-2:15.2.10-14.ge4949d65.el8.noarch 1/13 2021-03-30T04:59:31.976 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2021-03-30T04:59:31.976 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2021-03-30T04:59:31.977 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2021-03-30T04:59:31.977 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2021-03-30T04:59:31.977 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 6/13 2021-03-30T04:59:31.977 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2021-03-30T04:59:31.977 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 8/13 2021-03-30T04:59:31.978 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 9/13 2021-03-30T04:59:31.978 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 10/13 2021-03-30T04:59:31.978 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 11/13 2021-03-30T04:59:31.978 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 12/13 2021-03-30T04:59:32.348 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 13/13 2021-03-30T04:59:32.348 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:59:34.387 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:34.387 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:59:34.387 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-rook-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:59:34.388 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-03-30T04:59:34.388 INFO:teuthology.orchestra.run.smithi197.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-03-30T04:59:34.388 INFO:teuthology.orchestra.run.smithi197.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-03-30T04:59:34.388 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-03-30T04:59:34.389 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-03-30T04:59:34.389 INFO:teuthology.orchestra.run.smithi197.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-03-30T04:59:34.389 INFO:teuthology.orchestra.run.smithi197.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-03-30T04:59:34.389 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-03-30T04:59:34.389 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-03-30T04:59:34.390 INFO:teuthology.orchestra.run.smithi197.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-03-30T04:59:34.390 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-03-30T04:59:34.390 INFO:teuthology.orchestra.run.smithi197.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-03-30T04:59:34.390 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:34.391 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:34.676 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-cephadm 2021-03-30T04:59:35.030 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:35.515 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-03-30T04:59:35.644 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2021-03-30T04:59:37.141 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:37.142 INFO:teuthology.orchestra.run.smithi197.stdout:============================================================================================== 2021-03-30T04:59:37.142 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:59:37.142 INFO:teuthology.orchestra.run.smithi197.stdout:============================================================================================== 2021-03-30T04:59:37.143 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:59:37.143 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-cephadm noarch 2:15.2.10-14.ge4949d65.el8 ceph-noarch 68 k 2021-03-30T04:59:37.143 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:59:37.144 INFO:teuthology.orchestra.run.smithi197.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-03-30T04:59:37.144 INFO:teuthology.orchestra.run.smithi197.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-03-30T04:59:37.144 INFO:teuthology.orchestra.run.smithi197.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-03-30T04:59:37.145 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-03-30T04:59:37.145 INFO:teuthology.orchestra.run.smithi197.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-03-30T04:59:37.145 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:37.145 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:59:37.145 INFO:teuthology.orchestra.run.smithi197.stdout:============================================================================================== 2021-03-30T04:59:37.146 INFO:teuthology.orchestra.run.smithi197.stdout:Install 6 Packages 2021-03-30T04:59:37.146 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:37.147 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 5.8 M 2021-03-30T04:59:37.147 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 24 M 2021-03-30T04:59:37.147 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:59:37.225 INFO:teuthology.orchestra.run.smithi197.stdout:(1/6): python3-apipkg-1.5-6.el8.noarch.rpm 261 kB/s | 21 kB 00:00 2021-03-30T04:59:37.274 INFO:teuthology.orchestra.run.smithi197.stdout:(2/6): ceph-mgr-cephadm-15.2.10-14.ge4949d65.el 524 kB/s | 68 kB 00:00 2021-03-30T04:59:37.283 INFO:teuthology.orchestra.run.smithi197.stdout:(3/6): python3-remoto-1.1.4-4.el8.noarch.rpm 822 kB/s | 48 kB 00:00 2021-03-30T04:59:37.285 INFO:teuthology.orchestra.run.smithi197.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.5 MB/s | 355 kB 00:00 2021-03-30T04:59:37.317 INFO:teuthology.orchestra.run.smithi197.stdout:(5/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 13 MB/s | 538 kB 00:00 2021-03-30T04:59:37.341 INFO:teuthology.orchestra.run.smithi197.stdout:(6/6): python3-babel-2.5.1-5.el8.noarch.rpm 83 MB/s | 4.8 MB 00:00 2021-03-30T04:59:37.342 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:59:37.343 INFO:teuthology.orchestra.run.smithi197.stdout:Total 29 MB/s | 5.8 MB 00:00 2021-03-30T04:59:37.346 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:59:37.354 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:59:37.355 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:59:37.430 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:59:37.435 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:59:38.484 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:59:38.824 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/6 2021-03-30T04:59:39.047 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/6 2021-03-30T04:59:39.349 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 3/6 2021-03-30T04:59:39.607 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 4/6 2021-03-30T04:59:39.844 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 5/6 2021-03-30T04:59:40.332 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-cephadm-2:15.2.10-14.ge4949d65.el8.noarch 6/6 2021-03-30T04:59:40.569 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.10-14.ge4949d65.el8.noarch 6/6 2021-03-30T04:59:40.570 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-cephadm-2:15.2.10-14.ge4949d65.el8.noarch 1/6 2021-03-30T04:59:40.570 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 2/6 2021-03-30T04:59:40.570 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 3/6 2021-03-30T04:59:40.571 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 4/6 2021-03-30T04:59:40.571 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-03-30T04:59:40.893 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 6/6 2021-03-30T04:59:40.893 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:59:42.918 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:42.918 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:59:42.918 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-cephadm-2:15.2.10-14.ge4949d65.el8.noarch 2021-03-30T04:59:42.919 INFO:teuthology.orchestra.run.smithi197.stdout: python3-apipkg-1.5-6.el8.noarch 2021-03-30T04:59:42.919 INFO:teuthology.orchestra.run.smithi197.stdout: python3-babel-2.5.1-5.el8.noarch 2021-03-30T04:59:42.919 INFO:teuthology.orchestra.run.smithi197.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-03-30T04:59:42.919 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-03-30T04:59:42.919 INFO:teuthology.orchestra.run.smithi197.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-03-30T04:59:42.920 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:42.920 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:43.028 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-fuse 2021-03-30T04:59:43.384 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:43.873 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-03-30T04:59:44.003 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-03-30T04:59:45.505 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:45.506 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:59:45.506 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2021-03-30T04:59:45.506 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:59:45.506 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:59:45.507 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-fuse 2021-03-30T04:59:45.507 INFO:teuthology.orchestra.run.smithi197.stdout: x86_64 2:15.2.10-14.ge4949d65.el8 ceph 578 k 2021-03-30T04:59:45.507 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2021-03-30T04:59:45.507 INFO:teuthology.orchestra.run.smithi197.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-03-30T04:59:45.508 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:45.508 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:59:45.508 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:59:45.508 INFO:teuthology.orchestra.run.smithi197.stdout:Install 2 Packages 2021-03-30T04:59:45.508 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:45.509 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 660 k 2021-03-30T04:59:45.509 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 2.0 M 2021-03-30T04:59:45.509 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:59:45.556 INFO:teuthology.orchestra.run.smithi197.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2021-03-30T04:59:45.825 INFO:teuthology.orchestra.run.smithi197.stdout:(2/2): ceph-fuse-15.2.10-14.ge4949d65.el8.x86_6 1.8 MB/s | 578 kB 00:00 2021-03-30T04:59:45.910 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:59:45.910 INFO:teuthology.orchestra.run.smithi197.stdout:Total 2.0 MB/s | 660 kB 00:00 2021-03-30T04:59:45.910 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:59:45.911 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:59:45.911 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:59:45.931 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:59:45.936 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:59:46.100 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:59:46.330 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-03-30T04:59:46.512 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 2/2 2021-03-30T04:59:46.854 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 2/2 2021-03-30T04:59:46.854 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 1/2 2021-03-30T04:59:47.159 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-03-30T04:59:47.160 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:59:49.267 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:49.268 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:59:49.268 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-03-30T04:59:49.268 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:49.268 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:49.356 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install librados-devel 2021-03-30T04:59:49.713 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:50.201 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-03-30T04:59:50.330 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-03-30T04:59:52.678 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:52.679 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:59:52.679 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2021-03-30T04:59:52.679 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:59:52.680 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T04:59:52.680 INFO:teuthology.orchestra.run.smithi197.stdout: librados-devel x86_64 2:15.2.10-14.ge4949d65.el8 ceph 141 k 2021-03-30T04:59:52.680 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:52.680 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T04:59:52.681 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T04:59:52.681 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2021-03-30T04:59:52.681 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:52.681 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 141 k 2021-03-30T04:59:52.681 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 485 k 2021-03-30T04:59:52.682 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T04:59:52.830 INFO:teuthology.orchestra.run.smithi197.stdout:librados-devel-15.2.10-14.ge4949d65.el8.x86_64. 938 kB/s | 141 kB 00:00 2021-03-30T04:59:52.830 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T04:59:52.831 INFO:teuthology.orchestra.run.smithi197.stdout:Total 929 kB/s | 141 kB 00:00 2021-03-30T04:59:52.831 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T04:59:52.838 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T04:59:52.839 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T04:59:52.893 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T04:59:52.897 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T04:59:53.033 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T04:59:53.253 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librados-devel-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T04:59:53.500 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados-devel-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T04:59:53.771 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados-devel-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T04:59:53.771 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T04:59:55.893 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:55.893 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T04:59:55.893 INFO:teuthology.orchestra.run.smithi197.stdout: librados-devel-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T04:59:55.894 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T04:59:55.894 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:55.993 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install libcephfs2 2021-03-30T04:59:56.350 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:56.842 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-03-30T04:59:56.974 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-03-30T04:59:58.173 INFO:teuthology.orchestra.run.smithi197.stdout:Package libcephfs2-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T04:59:58.507 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T04:59:58.508 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T04:59:58.508 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T04:59:58.596 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install libcephfs-devel 2021-03-30T04:59:58.951 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T04:59:59.438 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-03-30T04:59:59.566 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-03-30T05:00:01.075 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:01.076 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:01.077 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2021-03-30T05:00:01.077 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:01.077 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T05:00:01.077 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs-devel x86_64 2:15.2.10-14.ge4949d65.el8 ceph 22 k 2021-03-30T05:00:01.078 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:01.078 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T05:00:01.078 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:01.078 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2021-03-30T05:00:01.078 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:01.079 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 22 k 2021-03-30T05:00:01.079 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 77 k 2021-03-30T05:00:01.079 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T05:00:01.189 INFO:teuthology.orchestra.run.smithi197.stdout:libcephfs-devel-15.2.10-14.ge4949d65.el8.x86_64 194 kB/s | 22 kB 00:00 2021-03-30T05:00:01.190 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T05:00:01.191 INFO:teuthology.orchestra.run.smithi197.stdout:Total 192 kB/s | 22 kB 00:00 2021-03-30T05:00:01.191 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T05:00:01.194 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T05:00:01.194 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T05:00:01.196 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T05:00:01.200 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T05:00:01.258 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T05:00:01.393 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcephfs-devel-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:01.649 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libcephfs-devel-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:01.897 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcephfs-devel-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:01.898 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T05:00:04.000 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:04.001 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T05:00:04.001 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs-devel-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T05:00:04.001 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:04.002 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:04.094 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install librados2 2021-03-30T05:00:04.453 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:04.949 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-03-30T05:00:05.079 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-03-30T05:00:06.314 INFO:teuthology.orchestra.run.smithi197.stdout:Package librados2-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T05:00:06.648 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:06.650 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T05:00:06.650 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:06.732 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install librbd1 2021-03-30T05:00:07.088 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:07.623 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2021-03-30T05:00:07.754 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2021-03-30T05:00:09.239 INFO:teuthology.orchestra.run.smithi197.stdout:Package librbd1-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T05:00:09.571 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:09.572 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T05:00:09.572 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:09.672 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-rados 2021-03-30T05:00:10.031 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:10.533 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-03-30T05:00:10.664 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2021-03-30T05:00:11.863 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-rados-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T05:00:12.197 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:12.198 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T05:00:12.198 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:12.276 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-rgw 2021-03-30T05:00:12.630 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:13.123 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-03-30T05:00:13.254 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2021-03-30T05:00:14.480 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-rgw-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T05:00:14.806 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:14.807 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T05:00:14.808 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:14.892 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-cephfs 2021-03-30T05:00:15.247 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:15.762 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 93 kB/s | 2.8 kB 00:00 2021-03-30T05:00:15.897 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2021-03-30T05:00:17.091 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-cephfs-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T05:00:17.422 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:17.423 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T05:00:17.424 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:17.523 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-rbd 2021-03-30T05:00:17.878 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:18.408 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 82 kB/s | 2.8 kB 00:00 2021-03-30T05:00:18.540 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 2021-03-30T05:00:19.704 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-rbd-2:15.2.10-14.ge4949d65.el8.x86_64 is already installed. 2021-03-30T05:00:20.032 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:20.033 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2021-03-30T05:00:20.033 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:20.126 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install rbd-fuse 2021-03-30T05:00:20.482 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:20.979 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 70 kB/s | 2.8 kB 00:00 2021-03-30T05:00:21.110 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 80 kB/s | 2.4 kB 00:00 2021-03-30T05:00:22.594 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:22.594 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:22.595 INFO:teuthology.orchestra.run.smithi197.stdout: Package Architecture Version Repository Size 2021-03-30T05:00:22.595 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:22.596 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T05:00:22.596 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-fuse x86_64 2:15.2.10-14.ge4949d65.el8 ceph 73 k 2021-03-30T05:00:22.596 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:22.597 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T05:00:22.597 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:22.598 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2021-03-30T05:00:22.598 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:22.598 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 73 k 2021-03-30T05:00:22.599 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 219 k 2021-03-30T05:00:22.599 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T05:00:22.724 INFO:teuthology.orchestra.run.smithi197.stdout:rbd-fuse-15.2.10-14.ge4949d65.el8.x86_64.rpm 562 kB/s | 73 kB 00:00 2021-03-30T05:00:22.726 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T05:00:22.726 INFO:teuthology.orchestra.run.smithi197.stdout:Total 555 kB/s | 73 kB 00:00 2021-03-30T05:00:22.726 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T05:00:22.738 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T05:00:22.738 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T05:00:22.794 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T05:00:22.798 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T05:00:22.923 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T05:00:23.123 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:23.372 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: rbd-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:23.633 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:23.633 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T05:00:25.751 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:25.751 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T05:00:25.752 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-fuse-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T05:00:25.752 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:25.752 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:25.843 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install rbd-mirror 2021-03-30T05:00:26.200 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:26.696 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-03-30T05:00:26.824 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 kB/s | 2.4 kB 00:00 2021-03-30T05:00:28.384 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:28.387 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:28.387 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2021-03-30T05:00:28.387 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:28.388 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T05:00:28.388 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-mirror x86_64 2:15.2.10-14.ge4949d65.el8 ceph 2.7 M 2021-03-30T05:00:28.388 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:28.388 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T05:00:28.389 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:28.389 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2021-03-30T05:00:28.389 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:28.389 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 2.7 M 2021-03-30T05:00:28.389 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 12 M 2021-03-30T05:00:28.390 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T05:00:30.207 INFO:teuthology.orchestra.run.smithi197.stdout:rbd-mirror-15.2.10-14.ge4949d65.el8.x86_64.rpm 1.5 MB/s | 2.7 MB 00:01 2021-03-30T05:00:30.208 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T05:00:30.209 INFO:teuthology.orchestra.run.smithi197.stdout:Total 1.5 MB/s | 2.7 MB 00:01 2021-03-30T05:00:30.210 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T05:00:30.226 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T05:00:30.226 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T05:00:30.297 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T05:00:30.302 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T05:00:30.672 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T05:00:30.882 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-mirror-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:31.242 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: rbd-mirror-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:31.509 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-mirror-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:31.509 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T05:00:33.599 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:33.599 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T05:00:33.600 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-mirror-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T05:00:33.600 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:33.600 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:33.695 DEBUG:teuthology.orchestra.run.smithi197:> sudo yum -y install rbd-nbd 2021-03-30T05:00:34.055 INFO:teuthology.orchestra.run.smithi197.stdout:Updating Subscription Management repositories. 2021-03-30T05:00:34.608 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-03-30T05:00:34.758 INFO:teuthology.orchestra.run.smithi197.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-03-30T05:00:36.264 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2021-03-30T05:00:36.266 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:36.267 INFO:teuthology.orchestra.run.smithi197.stdout: Package Architecture Version Repository Size 2021-03-30T05:00:36.267 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:36.268 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2021-03-30T05:00:36.268 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-nbd x86_64 2:15.2.10-14.ge4949d65.el8 ceph 142 k 2021-03-30T05:00:36.268 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:36.269 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2021-03-30T05:00:36.269 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2021-03-30T05:00:36.270 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2021-03-30T05:00:36.270 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:36.270 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 142 k 2021-03-30T05:00:36.271 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 520 k 2021-03-30T05:00:36.271 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2021-03-30T05:00:36.423 INFO:teuthology.orchestra.run.smithi197.stdout:rbd-nbd-15.2.10-14.ge4949d65.el8.x86_64.rpm 908 kB/s | 142 kB 00:00 2021-03-30T05:00:36.424 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2021-03-30T05:00:36.425 INFO:teuthology.orchestra.run.smithi197.stdout:Total 900 kB/s | 142 kB 00:00 2021-03-30T05:00:36.425 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2021-03-30T05:00:36.436 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2021-03-30T05:00:36.437 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2021-03-30T05:00:36.492 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2021-03-30T05:00:36.497 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2021-03-30T05:00:36.611 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2021-03-30T05:00:36.788 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-nbd-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:37.066 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: rbd-nbd-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:37.351 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-nbd-2:15.2.10-14.ge4949d65.el8.x86_64 1/1 2021-03-30T05:00:37.351 INFO:teuthology.orchestra.run.smithi197.stdout:Installed products updated. 2021-03-30T05:00:39.499 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:39.499 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2021-03-30T05:00:39.500 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-nbd-2:15.2.10-14.ge4949d65.el8.x86_64 2021-03-30T05:00:39.500 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-03-30T05:00:39.500 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2021-03-30T05:00:39.590 DEBUG:teuthology.parallel:result is None 2021-03-30T05:00:39.592 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2021-03-30T05:00:39.630 INFO:teuthology.orchestra.run.smithi197.stdout:RedHatEnterprise 2021-03-30T05:00:39.632 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-03-30T05:00:39.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e4949d651265114d7b464cd1e8986d9a31a26071 2021-03-30T05:00:39.789 DEBUG:teuthology.orchestra.run.smithi197:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-03-30T05:00:39.809 INFO:teuthology.orchestra.run.smithi197.stdout:15.2.10-14.ge4949d65.el8 2021-03-30T05:00:39.810 INFO:teuthology.packaging:The installed version of ceph is 15.2.10-14.ge4949d65.el8 2021-03-30T05:00:39.810 INFO:teuthology.task.install:The correct ceph version 15.2.10-14.ge4949d65 is installed. 2021-03-30T05:00:39.811 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-03-30T05:00:39.814 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-03-30T05:00:39.814 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-03-30T05:00:39.873 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-03-30T05:00:39.874 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-03-30T05:00:39.874 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/usr/bin/daemon-helper 2021-03-30T05:00:39.936 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-03-30T05:00:40.001 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-03-30T05:00:40.001 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-03-30T05:00:40.002 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/usr/bin/adjust-ulimits 2021-03-30T05:00:40.064 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-03-30T05:00:40.128 INFO:teuthology.run_tasks:Running task workunit... 2021-03-30T05:00:40.150 INFO:tasks.workunit:Pulling workunits from ref e4949d651265114d7b464cd1e8986d9a31a26071 2021-03-30T05:00:40.152 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-03-30T05:00:40.153 INFO:tasks.workunit:timeout=3h 2021-03-30T05:00:40.153 INFO:tasks.workunit:cleanup=True 2021-03-30T05:00:40.154 DEBUG:teuthology.orchestra.run.smithi197:> stat -- /home/ubuntu/cephtest/mnt.0 2021-03-30T05:00:40.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-03-30T05:00:40.183 INFO:teuthology.orchestra.run.smithi197.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-03-30T05:00:40.184 DEBUG:teuthology.orchestra.run.smithi197:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-03-30T05:00:40.238 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-03-30T05:00:40.239 DEBUG:teuthology.orchestra.run.smithi197:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-03-30T05:00:40.292 DEBUG:teuthology.orchestra.run.smithi197:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e4949d651265114d7b464cd1e8986d9a31a26071 2021-03-30T05:00:40.350 INFO:tasks.workunit.client.0.smithi197.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-03-30T05:02:01.887 INFO:tasks.workunit.client.0.smithi197.stderr:Note: switching to 'e4949d651265114d7b464cd1e8986d9a31a26071'. 2021-03-30T05:02:01.889 INFO:tasks.workunit.client.0.smithi197.stderr: 2021-03-30T05:02:01.889 INFO:tasks.workunit.client.0.smithi197.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-03-30T05:02:01.890 INFO:tasks.workunit.client.0.smithi197.stderr:changes and commit them, and you can discard any commits you make in this 2021-03-30T05:02:01.890 INFO:tasks.workunit.client.0.smithi197.stderr:state without impacting any branches by switching back to a branch. 2021-03-30T05:02:01.891 INFO:tasks.workunit.client.0.smithi197.stderr: 2021-03-30T05:02:01.891 INFO:tasks.workunit.client.0.smithi197.stderr:If you want to create a new branch to retain commits you create, you may 2021-03-30T05:02:01.892 INFO:tasks.workunit.client.0.smithi197.stderr:do so (now or later) by using -c with the switch command. Example: 2021-03-30T05:02:01.892 INFO:tasks.workunit.client.0.smithi197.stderr: 2021-03-30T05:02:01.893 INFO:tasks.workunit.client.0.smithi197.stderr: git switch -c 2021-03-30T05:02:01.893 INFO:tasks.workunit.client.0.smithi197.stderr: 2021-03-30T05:02:01.893 INFO:tasks.workunit.client.0.smithi197.stderr:Or undo this operation with: 2021-03-30T05:02:01.894 INFO:tasks.workunit.client.0.smithi197.stderr: 2021-03-30T05:02:01.894 INFO:tasks.workunit.client.0.smithi197.stderr: git switch - 2021-03-30T05:02:01.895 INFO:tasks.workunit.client.0.smithi197.stderr: 2021-03-30T05:02:01.895 INFO:tasks.workunit.client.0.smithi197.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-03-30T05:02:01.896 INFO:tasks.workunit.client.0.smithi197.stderr: 2021-03-30T05:02:01.896 INFO:tasks.workunit.client.0.smithi197.stderr:HEAD is now at e4949d65126 qa/standalone: default to disable insecure global id reclaim 2021-03-30T05:02:01.900 DEBUG:teuthology.orchestra.run.smithi197:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-03-30T05:02:02.011 DEBUG:teuthology.orchestra.remote:smithi197:/home/ubuntu/cephtest/workunits.list.client.0 is 1KB 2021-03-30T05:02:02.060 INFO:tasks.workunit:Running workunits matching misc on client.0... 2021-03-30T05:02:02.060 INFO:tasks.workunit:Running workunit misc/network-ping.sh... 2021-03-30T05:02:02.060 DEBUG:teuthology.orchestra.run.smithi197:workunit test misc/network-ping.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e4949d651265114d7b464cd1e8986d9a31a26071 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh 2021-03-30T05:02:02.094 INFO:tasks.workunit.client.0.smithi197.stderr:stty: 'standard input': Inappropriate ioctl for device 2021-03-30T05:02:02.102 INFO:tasks.workunit.client.0.smithi197.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2021-03-30T05:02:02.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2021-03-30T05:02:02.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2021-03-30T05:02:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2021-03-30T05:02:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2021-03-30T05:02:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2021-03-30T05:02:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2021-03-30T05:02:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2021-03-30T05:02:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2021-03-30T05:02:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/network-ping 2021-03-30T05:02:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:6: run: local dir=td/network-ping 2021-03-30T05:02:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:7: run: shift 2021-03-30T05:02:02.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:9: run: export CEPH_MON=127.0.0.1:7146 2021-03-30T05:02:02.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:9: run: CEPH_MON=127.0.0.1:7146 2021-03-30T05:02:02.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:10: run: export CEPH_ARGS 2021-03-30T05:02:02.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:11: run: uuidgen 2021-03-30T05:02:02.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:11: run: CEPH_ARGS+='--fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none ' 2021-03-30T05:02:02.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:12: run: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2021-03-30T05:02:02.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:13: run: CEPH_ARGS+='--debug_disable_randomized_ping=true ' 2021-03-30T05:02:02.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:14: run: CEPH_ARGS+='--debug_heartbeat_testing_span=5 ' 2021-03-30T05:02:02.108 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:15: run: CEPH_ARGS+='--osd_heartbeat_interval=1 ' 2021-03-30T05:02:02.108 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: set 2021-03-30T05:02:02.108 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2021-03-30T05:02:02.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:16: run: local 'funcs=TEST_network_ping_test1 2021-03-30T05:02:02.111 INFO:tasks.workunit.client.0.smithi197.stderr:TEST_network_ping_test2' 2021-03-30T05:02:02.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:17: run: for func in $funcs 2021-03-30T05:02:02.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:18: run: setup td/network-ping 2021-03-30T05:02:02.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/network-ping 2021-03-30T05:02:02.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/network-ping 2021-03-30T05:02:02.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2021-03-30T05:02:02.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:02:02.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2021-03-30T05:02:02.113 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:02:02.113 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:02:02.113 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:02:02.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:02:02.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:02:02.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:02:02.114 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:02:02.115 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:02:02.115 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:02:02.117 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:02:02.118 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:02:02.118 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:02:02.118 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:02:02.119 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:02:02.119 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:02:02.119 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:02:02.119 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:02:02.120 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:02:02.120 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2021-03-30T05:02:02.120 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:02:02.120 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:02.121 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:02.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.25988 2021-03-30T05:02:02.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:02:02.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:02:02.122 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/network-ping 2021-03-30T05:02:02.122 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:02:02.122 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:02.122 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:02.122 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.25988 2021-03-30T05:02:02.124 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:02:02.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2021-03-30T05:02:02.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2021-03-30T05:02:02.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:02:02.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/network-ping 1' TERM HUP INT 2021-03-30T05:02:02.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:19: run: TEST_network_ping_test1 td/network-ping 2021-03-30T05:02:02.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:25: TEST_network_ping_test1: local dir=td/network-ping 2021-03-30T05:02:02.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:27: TEST_network_ping_test1: run_mon td/network-ping a 2021-03-30T05:02:02.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/network-ping 2021-03-30T05:02:02.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:02:02.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:02:02.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:02:02.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/network-ping/a 2021-03-30T05:02:02.128 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/network-ping/a --run-dir=td/network-ping 2021-03-30T05:02:02.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:02:02.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:02:02.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:02:02.418 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:02:02.419 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:02.419 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:02.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:02.419 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/network-ping/a '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --mon-cluster-log-file=td/network-ping/log --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:02:02.560 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:02:02.562 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:02:02.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:02:02.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:02:02.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:02:02.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:02:02.564 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:02:02.564 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:02:02.564 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:02:02.564 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:02:02.565 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:02.565 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:02.565 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mon.a.asok 2021-03-30T05:02:02.565 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:02:02.566 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.25988/ceph-mon.a.asok config get fsid 2021-03-30T05:02:02.650 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:02:02.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:02:02.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:02:02.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:02:02.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:02:02.652 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:02:02.652 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:02:02.652 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:02:02.652 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:02:02.652 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:02.653 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:02.655 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mon.a.asok 2021-03-30T05:02:02.655 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:02:02.655 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.25988/ceph-mon.a.asok config get mon_host 2021-03-30T05:02:02.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:28: TEST_network_ping_test1: run_mgr td/network-ping x 2021-03-30T05:02:02.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/network-ping 2021-03-30T05:02:02.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:02:02.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:02:02.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:02:02.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/network-ping/x 2021-03-30T05:02:02.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:02:03.591 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:02:03.591 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:02:03.592 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:02:03.592 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:02:03.592 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:03.592 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:03.593 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:03.593 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:02:03.593 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/network-ping/x '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:02:03.616 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:29: TEST_network_ping_test1: run_osd td/network-ping 0 2021-03-30T05:02:03.617 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/network-ping 2021-03-30T05:02:03.617 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:02:03.617 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:02:03.617 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:02:03.617 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/network-ping/0 2021-03-30T05:02:03.618 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2021-03-30T05:02:03.618 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:02:03.618 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:02:03.618 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:02:03.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/network-ping/0' 2021-03-30T05:02:03.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/network-ping/0/journal' 2021-03-30T05:02:03.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:02:03.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:02:03.620 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/network-ping' 2021-03-30T05:02:03.620 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:02:03.620 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:02:03.620 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:02:03.620 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:02:03.621 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:03.621 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:03.621 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:03.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:03.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:02:03.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:02:03.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:02:03.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2021-03-30T05:02:03.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2021-03-30T05:02:03.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:02:03.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:02:03.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:02:03.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:02:03.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:02:03.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/network-ping/0 2021-03-30T05:02:03.624 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:02:03.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=eddc0538-8933-45d2-8095-402c1cfcb8d1 2021-03-30T05:02:03.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 eddc0538-8933-45d2-8095-402c1cfcb8d1' 2021-03-30T05:02:03.625 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 eddc0538-8933-45d2-8095-402c1cfcb8d1 2021-03-30T05:02:03.625 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:02:03.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDLsGJgA62GJRAAkZrXXhdKIhPOutVFeuV1XA== 2021-03-30T05:02:03.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDLsGJgA62GJRAAkZrXXhdKIhPOutVFeuV1XA=="}' 2021-03-30T05:02:03.631 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new eddc0538-8933-45d2-8095-402c1cfcb8d1 -i td/network-ping/0/new.json 2021-03-30T05:02:03.929 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:02:03.939 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/network-ping/0/new.json 2021-03-30T05:02:03.939 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDLsGJgA62GJRAAkZrXXhdKIhPOutVFeuV1XA== --osd-uuid eddc0538-8933-45d2-8095-402c1cfcb8d1 2021-03-30T05:02:03.963 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:03.962+0000 7f6d93115f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:03.965 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:03.964+0000 7f6d93115f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:03.966 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:03.965+0000 7f6d93115f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:03.966 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:03.965+0000 7f6d93115f40 -1 bluestore(td/network-ping/0/block) _read_bdev_label failed to open td/network-ping/0/block: (2) No such file or directory 2021-03-30T05:02:03.967 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:03.965+0000 7f6d93115f40 -1 bluestore(td/network-ping/0/block) _read_bdev_label failed to open td/network-ping/0/block: (2) No such file or directory 2021-03-30T05:02:03.967 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:03.965+0000 7f6d93115f40 -1 bluestore(td/network-ping/0/block) _read_bdev_label failed to open td/network-ping/0/block: (2) No such file or directory 2021-03-30T05:02:04.010 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:04.009+0000 7f6d93115f40 -1 bluestore(td/network-ping/0) _read_fsid unparsable uuid 2021-03-30T05:02:04.530 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:04.529+0000 7f6d93115f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:02:07.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/network-ping/0/keyring 2021-03-30T05:02:07.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:02:07.050 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:02:07.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:02:07.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/network-ping/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:02:07.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:02:07.277 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:02:07.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:02:07.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:02:07.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:02:07.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:02:07.299 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:07.298+0000 7fdda30ddf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:07.300 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:07.299+0000 7fdda30ddf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:07.301 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:07.300+0000 7fdda30ddf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:07.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:02:07.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:02:07.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:02:07.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:02:07.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:02:07.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:02:07.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:02:07.497 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:02:07.498 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:02:07.498 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:02:07.710 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:02:07.816 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:07.816+0000 7fdda30ddf40 -1 Falling back to public interface 2021-03-30T05:02:08.528 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:08.527+0000 7fdda30ddf40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:02:08.711 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:02:08.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:02:08.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:02:08.712 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:02:08.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:02:08.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:02:09.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:02:10.122 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:02:10.122 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:02:10.122 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:02:10.123 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:02:10.123 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:02:10.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:02:10.480 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/26360,v1:127.0.0.1:6801/26360] [v2:127.0.0.1:6802/26360,v1:127.0.0.1:6803/26360] exists,up eddc0538-8933-45d2-8095-402c1cfcb8d1 2021-03-30T05:02:10.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:02:10.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:02:10.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:02:10.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:30: TEST_network_ping_test1: run_osd td/network-ping 1 2021-03-30T05:02:10.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/network-ping 2021-03-30T05:02:10.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:02:10.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:02:10.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:02:10.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/network-ping/1 2021-03-30T05:02:10.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2021-03-30T05:02:10.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:02:10.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:02:10.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:02:10.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/network-ping/1' 2021-03-30T05:02:10.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/network-ping/1/journal' 2021-03-30T05:02:10.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:02:10.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:02:10.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/network-ping' 2021-03-30T05:02:10.489 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:02:10.489 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:02:10.489 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:02:10.490 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:02:10.490 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:10.490 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:10.490 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:10.490 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:10.491 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:02:10.491 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:02:10.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:02:10.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2021-03-30T05:02:10.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2021-03-30T05:02:10.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:02:10.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:02:10.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:02:10.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:02:10.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:02:10.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/network-ping/1 2021-03-30T05:02:10.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:02:10.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e7d599f9-ed3f-4b13-81f6-f822580794e4 2021-03-30T05:02:10.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 e7d599f9-ed3f-4b13-81f6-f822580794e4' 2021-03-30T05:02:10.497 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 e7d599f9-ed3f-4b13-81f6-f822580794e4 2021-03-30T05:02:10.499 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:02:10.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDSsGJga+SWHRAA8NMbs68UaTt3N+CfungyEA== 2021-03-30T05:02:10.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDSsGJga+SWHRAA8NMbs68UaTt3N+CfungyEA=="}' 2021-03-30T05:02:10.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e7d599f9-ed3f-4b13-81f6-f822580794e4 -i td/network-ping/1/new.json 2021-03-30T05:02:10.921 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:02:10.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/network-ping/1/new.json 2021-03-30T05:02:10.932 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDSsGJga+SWHRAA8NMbs68UaTt3N+CfungyEA== --osd-uuid e7d599f9-ed3f-4b13-81f6-f822580794e4 2021-03-30T05:02:10.955 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:10.953+0000 7fa77d17cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:10.956 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:10.955+0000 7fa77d17cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:10.958 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:10.956+0000 7fa77d17cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:10.959 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:10.957+0000 7fa77d17cf40 -1 bluestore(td/network-ping/1/block) _read_bdev_label failed to open td/network-ping/1/block: (2) No such file or directory 2021-03-30T05:02:10.959 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:10.957+0000 7fa77d17cf40 -1 bluestore(td/network-ping/1/block) _read_bdev_label failed to open td/network-ping/1/block: (2) No such file or directory 2021-03-30T05:02:10.959 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:10.957+0000 7fa77d17cf40 -1 bluestore(td/network-ping/1/block) _read_bdev_label failed to open td/network-ping/1/block: (2) No such file or directory 2021-03-30T05:02:10.988 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:10.986+0000 7fa77d17cf40 -1 bluestore(td/network-ping/1) _read_fsid unparsable uuid 2021-03-30T05:02:11.415 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:11.413+0000 7fa77d17cf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:02:14.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/network-ping/1/keyring 2021-03-30T05:02:14.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:02:14.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:02:14.037 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:02:14.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/network-ping/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:02:14.510 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:02:14.512 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:02:14.512 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:02:14.512 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:02:14.513 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:02:14.513 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:02:14.531 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:14.530+0000 7f637d0a0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:14.533 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:14.531+0000 7f637d0a0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:14.534 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:14.533+0000 7f637d0a0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:14.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:02:14.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:02:14.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:02:14.865 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:02:14.865 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:02:14.865 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:02:14.865 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:02:14.866 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:02:14.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:02:14.867 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:02:15.049 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:15.047+0000 7f637d0a0f40 -1 Falling back to public interface 2021-03-30T05:02:15.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:02:15.813 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:15.811+0000 7f637d0a0f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:02:16.214 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:02:16.215 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:02:16.215 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:02:16.215 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:02:16.216 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:02:16.216 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:02:16.596 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/26800,v1:127.0.0.1:6811/26800] [v2:127.0.0.1:6812/26800,v1:127.0.0.1:6813/26800] exists,up e7d599f9-ed3f-4b13-81f6-f822580794e4 2021-03-30T05:02:16.600 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:02:16.600 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:02:16.600 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:02:16.601 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:31: TEST_network_ping_test1: run_osd td/network-ping 2 2021-03-30T05:02:16.601 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/network-ping 2021-03-30T05:02:16.601 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:02:16.601 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2021-03-30T05:02:16.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:02:16.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/network-ping/2 2021-03-30T05:02:16.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2021-03-30T05:02:16.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:02:16.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:02:16.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:02:16.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/network-ping/2' 2021-03-30T05:02:16.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/network-ping/2/journal' 2021-03-30T05:02:16.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:02:16.604 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:02:16.604 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/network-ping' 2021-03-30T05:02:16.604 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:02:16.604 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:02:16.604 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:02:16.605 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:02:16.605 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:16.605 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:16.605 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:16.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:02:16.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:02:16.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:02:16.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:02:16.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2021-03-30T05:02:16.607 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2021-03-30T05:02:16.607 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:02:16.607 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:02:16.607 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:02:16.608 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:02:16.608 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:02:16.608 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/network-ping/2 2021-03-30T05:02:16.608 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:02:16.608 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=01e3e61d-6b4c-4282-9b89-3d85278d6751 2021-03-30T05:02:16.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 01e3e61d-6b4c-4282-9b89-3d85278d6751' 2021-03-30T05:02:16.609 INFO:tasks.workunit.client.0.smithi197.stdout:add osd2 01e3e61d-6b4c-4282-9b89-3d85278d6751 2021-03-30T05:02:16.609 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:02:16.614 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDYsGJg/w2ZJBAABLFxilOHBFuKzpoxEcGd9Q== 2021-03-30T05:02:16.615 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDYsGJg/w2ZJBAABLFxilOHBFuKzpoxEcGd9Q=="}' 2021-03-30T05:02:16.615 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 01e3e61d-6b4c-4282-9b89-3d85278d6751 -i td/network-ping/2/new.json 2021-03-30T05:02:17.095 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:02:17.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/network-ping/2/new.json 2021-03-30T05:02:17.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDYsGJg/w2ZJBAABLFxilOHBFuKzpoxEcGd9Q== --osd-uuid 01e3e61d-6b4c-4282-9b89-3d85278d6751 2021-03-30T05:02:17.130 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.128+0000 7f3d462c9f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:17.131 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.129+0000 7f3d462c9f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:17.132 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.130+0000 7f3d462c9f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:17.133 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.131+0000 7f3d462c9f40 -1 bluestore(td/network-ping/2/block) _read_bdev_label failed to open td/network-ping/2/block: (2) No such file or directory 2021-03-30T05:02:17.133 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.131+0000 7f3d462c9f40 -1 bluestore(td/network-ping/2/block) _read_bdev_label failed to open td/network-ping/2/block: (2) No such file or directory 2021-03-30T05:02:17.133 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.131+0000 7f3d462c9f40 -1 bluestore(td/network-ping/2/block) _read_bdev_label failed to open td/network-ping/2/block: (2) No such file or directory 2021-03-30T05:02:17.178 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.177+0000 7f3d462c9f40 -1 bluestore(td/network-ping/2) _read_fsid unparsable uuid 2021-03-30T05:02:17.548 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:17.546+0000 7f3d462c9f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:02:20.501 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/network-ping/2/keyring 2021-03-30T05:02:20.502 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:02:20.503 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd2 key to auth repository 2021-03-30T05:02:20.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2021-03-30T05:02:20.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/network-ping/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:02:20.984 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:02:20.986 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2021-03-30T05:02:20.986 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:02:20.986 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:02:20.987 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:02:20.987 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:02:21.005 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:21.003+0000 7f3e3590df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:21.031 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:21.029+0000 7f3e3590df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:21.032 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:21.031+0000 7f3e3590df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:02:21.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2021-03-30T05:02:21.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:02:21.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:02:21.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:02:21.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:02:21.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:02:21.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:02:21.341 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:02:21.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:02:21.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:02:21.550 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:21.548+0000 7f3e3590df40 -1 Falling back to public interface 2021-03-30T05:02:21.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:02:22.263 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:02:22.261+0000 7f3e3590df40 -1 osd.2 0 log_to_monitors {default=true} 2021-03-30T05:02:22.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:02:22.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:02:22.714 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:02:22.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:02:22.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:02:22.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:02:23.134 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/27169,v1:127.0.0.1:6819/27169] [v2:127.0.0.1:6820/27169,v1:127.0.0.1:6821/27169] exists,up 01e3e61d-6b4c-4282-9b89-3d85278d6751 2021-03-30T05:02:23.135 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:02:23.135 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:02:23.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:02:23.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:33: TEST_network_ping_test1: sleep 5 2021-03-30T05:02:28.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:35: TEST_network_ping_test1: create_pool foo 16 2021-03-30T05:02:28.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create foo 16 2021-03-30T05:02:28.820 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'foo' already exists 2021-03-30T05:02:28.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:02:29.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:38: TEST_network_ping_test1: timeout 20 rados bench -p foo 10 write -b 4096 --no-cleanup 2021-03-30T05:02:29.876 INFO:tasks.workunit.client.0.smithi197.stdout:hints = 1 2021-03-30T05:02:29.876 INFO:tasks.workunit.client.0.smithi197.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 0 objects 2021-03-30T05:02:29.876 INFO:tasks.workunit.client.0.smithi197.stdout:Object prefix: benchmark_data_smithi197_27378 2021-03-30T05:02:29.877 INFO:tasks.workunit.client.0.smithi197.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-03-30T05:02:29.877 INFO:tasks.workunit.client.0.smithi197.stdout: 0 0 0 0 0 0 - 0 2021-03-30T05:02:30.876 INFO:tasks.workunit.client.0.smithi197.stdout: 1 16 65 49 0.191387 0.191406 0.259521 0.276059 2021-03-30T05:02:31.876 INFO:tasks.workunit.client.0.smithi197.stdout: 2 16 114 98 0.191387 0.191406 0.241724 0.296257 2021-03-30T05:02:32.876 INFO:tasks.workunit.client.0.smithi197.stdout: 3 16 162 146 0.190083 0.1875 0.260201 0.301897 2021-03-30T05:02:33.876 INFO:tasks.workunit.client.0.smithi197.stdout: 4 16 224 208 0.203101 0.242188 0.258076 0.300739 2021-03-30T05:02:34.876 INFO:tasks.workunit.client.0.smithi197.stdout: 5 16 272 256 0.199976 0.1875 0.461366 0.304078 2021-03-30T05:02:35.876 INFO:tasks.workunit.client.0.smithi197.stdout: 6 16 290 274 0.178364 0.0703125 0.706787 0.308329 2021-03-30T05:02:36.877 INFO:tasks.workunit.client.0.smithi197.stdout: 7 16 305 289 0.161252 0.0585938 1.27717 0.353061 2021-03-30T05:02:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: 8 16 321 305 0.148906 0.0625 1.03093 0.387077 2021-03-30T05:02:38.877 INFO:tasks.workunit.client.0.smithi197.stdout: 9 16 370 354 0.153625 0.191406 0.258668 0.397624 2021-03-30T05:02:39.877 INFO:tasks.workunit.client.0.smithi197.stdout: 10 16 432 416 0.162479 0.242188 0.239054 0.382429 2021-03-30T05:02:40.877 INFO:tasks.workunit.client.0.smithi197.stdout:Total time run: 10.1285 2021-03-30T05:02:40.878 INFO:tasks.workunit.client.0.smithi197.stdout:Total writes made: 432 2021-03-30T05:02:40.878 INFO:tasks.workunit.client.0.smithi197.stdout:Write size: 4096 2021-03-30T05:02:40.878 INFO:tasks.workunit.client.0.smithi197.stdout:Object size: 4096 2021-03-30T05:02:40.878 INFO:tasks.workunit.client.0.smithi197.stdout:Bandwidth (MB/sec): 0.16661 2021-03-30T05:02:40.879 INFO:tasks.workunit.client.0.smithi197.stdout:Stddev Bandwidth: 0.071299 2021-03-30T05:02:40.879 INFO:tasks.workunit.client.0.smithi197.stdout:Max bandwidth (MB/sec): 0.242188 2021-03-30T05:02:40.879 INFO:tasks.workunit.client.0.smithi197.stdout:Min bandwidth (MB/sec): 0.0585938 2021-03-30T05:02:40.880 INFO:tasks.workunit.client.0.smithi197.stdout:Average IOPS: 42 2021-03-30T05:02:40.880 INFO:tasks.workunit.client.0.smithi197.stdout:Stddev IOPS: 18.2525 2021-03-30T05:02:40.880 INFO:tasks.workunit.client.0.smithi197.stdout:Max IOPS: 62 2021-03-30T05:02:40.880 INFO:tasks.workunit.client.0.smithi197.stdout:Min IOPS: 15 2021-03-30T05:02:40.880 INFO:tasks.workunit.client.0.smithi197.stdout:Average Latency(s): 0.374885 2021-03-30T05:02:40.881 INFO:tasks.workunit.client.0.smithi197.stdout:Stddev Latency(s): 0.246404 2021-03-30T05:02:40.881 INFO:tasks.workunit.client.0.smithi197.stdout:Max latency(s): 1.27717 2021-03-30T05:02:40.881 INFO:tasks.workunit.client.0.smithi197.stdout:Min latency(s): 0.171506 2021-03-30T05:02:40.974 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:41: TEST_network_ping_test1: sleep 10 2021-03-30T05:02:50.976 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:42: TEST_network_ping_test1: flush_pg_stats 2021-03-30T05:02:50.976 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:02:50.977 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:02:51.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:02:51.339 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:02:51.339 INFO:tasks.workunit.client.0.smithi197.stderr:2' 2021-03-30T05:02:51.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:02:51.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:02:51.341 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:02:51.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2021-03-30T05:02:51.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2021-03-30T05:02:51.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2021-03-30T05:02:51.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:02:51.474 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:02:51.596 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672969 2021-03-30T05:02:51.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672969 2021-03-30T05:02:51.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969' 2021-03-30T05:02:51.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:02:51.597 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:02:51.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542152 2021-03-30T05:02:51.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542152 2021-03-30T05:02:51.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-42949672969 2-60129542152' 2021-03-30T05:02:51.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:02:51.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2021-03-30T05:02:51.722 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:02:51.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:02:51.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2021-03-30T05:02:51.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:02:51.723 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2021-03-30T05:02:51.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2021-03-30T05:02:51.724 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836491 2021-03-30T05:02:51.725 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:02:52.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836491 2021-03-30T05:02:52.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:02:53.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:02:53.085 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:02:53.445 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2021-03-30T05:02:53.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:02:53.446 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672969 2021-03-30T05:02:53.447 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:02:53.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:02:53.448 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672969 2021-03-30T05:02:53.449 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:02:53.450 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672969 2021-03-30T05:02:53.450 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2021-03-30T05:02:53.451 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 42949672969 2021-03-30T05:02:53.452 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:02:53.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672969 -lt 42949672969 2021-03-30T05:02:53.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:02:53.803 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542152 2021-03-30T05:02:53.803 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:02:53.804 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:02:53.805 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542152 2021-03-30T05:02:53.806 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:02:53.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542152 2021-03-30T05:02:53.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2021-03-30T05:02:53.807 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 60129542152 2021-03-30T05:02:53.808 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:02:54.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542153 -lt 60129542152 2021-03-30T05:02:54.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:02:54.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: get_asok_path osd.0 2021-03-30T05:02:54.171 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:02:54.171 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:02:54.172 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:02:54.172 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:54.172 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:54.172 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-osd.0.asok 2021-03-30T05:02:54.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:02:54.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:44: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-osd.0.asok dump_osd_network 2021-03-30T05:02:54.257 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:02:54.257 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 1000, 2021-03-30T05:02:54.257 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:02:54.258 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:02:54.266 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.266 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:02:54.267 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:45: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:02:54.269 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.269 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: jq .threshold 2021-03-30T05:02:54.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:46: TEST_network_ping_test1: test 1000 = 1000 2021-03-30T05:02:54.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:02:54.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: get_asok_path mgr.x 2021-03-30T05:02:54.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2021-03-30T05:02:54.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2021-03-30T05:02:54.273 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:02:54.274 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:54.274 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:54.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mgr.x.asok 2021-03-30T05:02:54.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:02:54.275 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:48: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-mgr.x.asok dump_osd_network 2021-03-30T05:02:54.351 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:02:54.351 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 1000, 2021-03-30T05:02:54.351 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:02:54.352 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:02:54.359 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.359 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:02:54.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:49: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:02:54.362 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.362 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: jq .threshold 2021-03-30T05:02:54.364 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:50: TEST_network_ping_test1: test 1000 = 1000 2021-03-30T05:02:54.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:02:54.366 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: get_asok_path osd.0 2021-03-30T05:02:54.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:02:54.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:02:54.367 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:02:54.367 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:54.368 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:54.368 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-osd.0.asok 2021-03-30T05:02:54.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:02:54.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:52: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-osd.0.asok dump_osd_network 0 2021-03-30T05:02:54.453 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:02:54.454 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 0, 2021-03-30T05:02:54.454 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [ 2021-03-30T05:02:54.455 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.455 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:49 2021", 2021-03-30T05:02:54.456 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.456 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.457 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:02:54.457 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.457 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.458 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.301, 2021-03-30T05:02:54.458 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.328, 2021-03-30T05:02:54.459 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.319 2021-03-30T05:02:54.459 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.460 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.460 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.409, 2021-03-30T05:02:54.460 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.454, 2021-03-30T05:02:54.461 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.454 2021-03-30T05:02:54.461 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.462 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.462 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.409, 2021-03-30T05:02:54.462 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.454, 2021-03-30T05:02:54.463 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.454 2021-03-30T05:02:54.463 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.464 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.249 2021-03-30T05:02:54.464 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.465 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.465 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:49 2021", 2021-03-30T05:02:54.465 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.466 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.466 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:02:54.467 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.468 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.468 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.302, 2021-03-30T05:02:54.468 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.321, 2021-03-30T05:02:54.469 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.318 2021-03-30T05:02:54.470 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.470 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.471 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.452, 2021-03-30T05:02:54.471 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.452, 2021-03-30T05:02:54.472 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.452 2021-03-30T05:02:54.472 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.472 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.473 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.452, 2021-03-30T05:02:54.473 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.452, 2021-03-30T05:02:54.474 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.452 2021-03-30T05:02:54.474 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.475 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.237 2021-03-30T05:02:54.475 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.476 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.476 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:52 2021", 2021-03-30T05:02:54.477 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.477 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.477 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:02:54.478 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.478 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.479 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.286, 2021-03-30T05:02:54.479 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.299, 2021-03-30T05:02:54.479 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.315 2021-03-30T05:02:54.480 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.480 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.481 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.419, 2021-03-30T05:02:54.481 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.434, 2021-03-30T05:02:54.481 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.720 2021-03-30T05:02:54.482 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.482 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.483 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.419, 2021-03-30T05:02:54.483 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.434, 2021-03-30T05:02:54.483 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.720 2021-03-30T05:02:54.484 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.484 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.226 2021-03-30T05:02:54.485 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.485 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.485 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:52 2021", 2021-03-30T05:02:54.486 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.486 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.486 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:02:54.487 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.487 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.487 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.292, 2021-03-30T05:02:54.487 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.296, 2021-03-30T05:02:54.488 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.314 2021-03-30T05:02:54.488 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.488 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.488 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.441, 2021-03-30T05:02:54.489 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.462, 2021-03-30T05:02:54.489 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.743 2021-03-30T05:02:54.489 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.489 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.490 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.441, 2021-03-30T05:02:54.490 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.462, 2021-03-30T05:02:54.490 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.743 2021-03-30T05:02:54.490 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.491 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.216 2021-03-30T05:02:54.491 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:02:54.491 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:02:54.492 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:02:54.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:02:54.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:53: TEST_network_ping_test1: test 4 = 4 2021-03-30T05:02:54.496 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.496 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: jq .threshold 2021-03-30T05:02:54.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:54: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:02:54.497 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:02:54.497 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: get_asok_path mgr.x 2021-03-30T05:02:54.498 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2021-03-30T05:02:54.498 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2021-03-30T05:02:54.498 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:02:54.499 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:02:54.499 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:02:54.499 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mgr.x.asok 2021-03-30T05:02:54.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:02:54.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:56: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-mgr.x.asok dump_osd_network 0 2021-03-30T05:02:54.546 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:02:54.547 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 0, 2021-03-30T05:02:54.547 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [ 2021-03-30T05:02:54.548 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.548 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:48 2021", 2021-03-30T05:02:54.548 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.548 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:02:54.549 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:02:54.549 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.549 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.550 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.335, 2021-03-30T05:02:54.550 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.330, 2021-03-30T05:02:54.550 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.342 2021-03-30T05:02:54.550 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.551 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.551 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.257, 2021-03-30T05:02:54.551 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.206, 2021-03-30T05:02:54.551 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.206 2021-03-30T05:02:54.552 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.552 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.552 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.433, 2021-03-30T05:02:54.553 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.458, 2021-03-30T05:02:54.553 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.458 2021-03-30T05:02:54.554 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.554 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.201 2021-03-30T05:02:54.555 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.555 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.555 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:48 2021", 2021-03-30T05:02:54.555 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.555 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:02:54.556 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:02:54.556 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.556 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.556 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.331, 2021-03-30T05:02:54.557 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.318, 2021-03-30T05:02:54.557 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.331 2021-03-30T05:02:54.557 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.558 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.558 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.250, 2021-03-30T05:02:54.558 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.189, 2021-03-30T05:02:54.558 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.189 2021-03-30T05:02:54.559 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.559 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.559 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.412, 2021-03-30T05:02:54.559 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.491, 2021-03-30T05:02:54.560 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.491 2021-03-30T05:02:54.560 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.560 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.209 2021-03-30T05:02:54.560 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.561 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.561 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:49 2021", 2021-03-30T05:02:54.561 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.561 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.562 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:02:54.562 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.562 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.563 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.301, 2021-03-30T05:02:54.563 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.328, 2021-03-30T05:02:54.563 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.319 2021-03-30T05:02:54.563 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.564 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.564 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.232, 2021-03-30T05:02:54.564 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.222, 2021-03-30T05:02:54.564 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.222 2021-03-30T05:02:54.565 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.565 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.565 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.409, 2021-03-30T05:02:54.566 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.454, 2021-03-30T05:02:54.566 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.454 2021-03-30T05:02:54.566 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.566 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.379 2021-03-30T05:02:54.567 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.567 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.567 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:49 2021", 2021-03-30T05:02:54.567 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.568 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.568 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:02:54.568 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.568 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.569 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.302, 2021-03-30T05:02:54.569 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.321, 2021-03-30T05:02:54.569 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.318 2021-03-30T05:02:54.569 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.570 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.570 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.240, 2021-03-30T05:02:54.570 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.206, 2021-03-30T05:02:54.571 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.206 2021-03-30T05:02:54.571 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.571 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.571 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.452, 2021-03-30T05:02:54.572 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.452, 2021-03-30T05:02:54.572 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.452 2021-03-30T05:02:54.572 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.572 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.343 2021-03-30T05:02:54.573 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.573 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.573 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:47 2021", 2021-03-30T05:02:54.573 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.574 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.574 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:02:54.574 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.574 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.575 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.301, 2021-03-30T05:02:54.575 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.308, 2021-03-30T05:02:54.575 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.318 2021-03-30T05:02:54.576 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.576 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.576 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.216, 2021-03-30T05:02:54.576 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.180, 2021-03-30T05:02:54.577 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.169 2021-03-30T05:02:54.577 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.577 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.577 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.434, 2021-03-30T05:02:54.578 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.434, 2021-03-30T05:02:54.578 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.720 2021-03-30T05:02:54.578 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.579 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.362 2021-03-30T05:02:54.579 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.579 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.579 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:47 2021", 2021-03-30T05:02:54.580 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.580 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:02:54.580 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:02:54.580 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.581 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.581 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.299, 2021-03-30T05:02:54.581 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.300, 2021-03-30T05:02:54.582 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.316 2021-03-30T05:02:54.582 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.582 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.582 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.207, 2021-03-30T05:02:54.583 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.192, 2021-03-30T05:02:54.583 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.189 2021-03-30T05:02:54.583 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.583 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.584 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.462, 2021-03-30T05:02:54.584 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.462, 2021-03-30T05:02:54.584 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.743 2021-03-30T05:02:54.585 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.585 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.353 2021-03-30T05:02:54.585 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.585 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.586 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:53 2021", 2021-03-30T05:02:54.586 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.586 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:02:54.587 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:02:54.587 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.587 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.588 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.236, 2021-03-30T05:02:54.588 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.308, 2021-03-30T05:02:54.588 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.289 2021-03-30T05:02:54.588 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.589 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.589 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.206, 2021-03-30T05:02:54.589 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.206, 2021-03-30T05:02:54.589 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.206 2021-03-30T05:02:54.590 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.590 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.590 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.268, 2021-03-30T05:02:54.591 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.445, 2021-03-30T05:02:54.591 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.445 2021-03-30T05:02:54.591 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.591 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.206 2021-03-30T05:02:54.592 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.592 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.592 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:53 2021", 2021-03-30T05:02:54.592 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.593 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:02:54.593 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:02:54.593 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.593 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.594 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.236, 2021-03-30T05:02:54.594 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.307, 2021-03-30T05:02:54.594 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.289 2021-03-30T05:02:54.595 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.595 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.595 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.202, 2021-03-30T05:02:54.595 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.202, 2021-03-30T05:02:54.596 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.202 2021-03-30T05:02:54.596 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.596 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.597 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.310, 2021-03-30T05:02:54.597 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.457, 2021-03-30T05:02:54.597 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.457 2021-03-30T05:02:54.598 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.598 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.212 2021-03-30T05:02:54.598 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.599 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.599 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:51 2021", 2021-03-30T05:02:54.599 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.599 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:02:54.600 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:02:54.600 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.600 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.601 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.297, 2021-03-30T05:02:54.601 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.300, 2021-03-30T05:02:54.601 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.260 2021-03-30T05:02:54.601 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.602 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.602 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.225, 2021-03-30T05:02:54.602 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.178, 2021-03-30T05:02:54.602 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.178 2021-03-30T05:02:54.603 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.603 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.603 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.381, 2021-03-30T05:02:54.603 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.501, 2021-03-30T05:02:54.604 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.501 2021-03-30T05:02:54.604 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.604 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.225 2021-03-30T05:02:54.604 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.605 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.605 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:53 2021", 2021-03-30T05:02:54.605 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.605 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:02:54.606 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:02:54.606 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:02:54.606 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.606 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.219, 2021-03-30T05:02:54.607 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.287, 2021-03-30T05:02:54.607 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.263 2021-03-30T05:02:54.607 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.607 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.608 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.198, 2021-03-30T05:02:54.608 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.198, 2021-03-30T05:02:54.608 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.198 2021-03-30T05:02:54.608 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.609 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.609 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.258, 2021-03-30T05:02:54.609 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.428, 2021-03-30T05:02:54.609 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.428 2021-03-30T05:02:54.610 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.610 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.198 2021-03-30T05:02:54.610 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.610 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.611 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:53 2021", 2021-03-30T05:02:54.611 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.611 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:02:54.612 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:02:54.612 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.612 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.612 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.234, 2021-03-30T05:02:54.612 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.281, 2021-03-30T05:02:54.613 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.261 2021-03-30T05:02:54.613 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.613 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.613 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.193, 2021-03-30T05:02:54.614 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.187, 2021-03-30T05:02:54.614 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.181 2021-03-30T05:02:54.614 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.614 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.614 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.276, 2021-03-30T05:02:54.615 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.412, 2021-03-30T05:02:54.615 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.412 2021-03-30T05:02:54.615 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.615 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.255 2021-03-30T05:02:54.616 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.616 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:02:54.616 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:02:51 2021", 2021-03-30T05:02:54.616 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:02:54.616 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:02:54.617 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:02:54.617 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:02:54.617 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:02:54.617 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.257, 2021-03-30T05:02:54.617 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.277, 2021-03-30T05:02:54.618 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.239 2021-03-30T05:02:54.618 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.618 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:02:54.618 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.188, 2021-03-30T05:02:54.619 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.162, 2021-03-30T05:02:54.619 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.162 2021-03-30T05:02:54.619 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.619 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:02:54.619 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.347, 2021-03-30T05:02:54.620 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.455, 2021-03-30T05:02:54.620 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.455 2021-03-30T05:02:54.620 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:02:54.620 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.188 2021-03-30T05:02:54.620 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:02:54.621 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:02:54.621 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:02:54.622 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.623 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:02:54.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:57: TEST_network_ping_test1: test 12 = 12 2021-03-30T05:02:54.623 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:02:54.623 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: jq .threshold 2021-03-30T05:02:54.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:58: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:02:54.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:61: TEST_network_ping_test1: sleep 20 2021-03-30T05:03:14.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:62: TEST_network_ping_test1: flush_pg_stats 2021-03-30T05:03:14.562 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:03:14.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:03:14.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:03:14.922 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:03:14.922 INFO:tasks.workunit.client.0.smithi197.stderr:2' 2021-03-30T05:03:14.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:03:14.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:03:14.923 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:03:15.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836498 2021-03-30T05:03:15.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836498 2021-03-30T05:03:15.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498' 2021-03-30T05:03:15.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:03:15.057 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:03:15.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672976 2021-03-30T05:03:15.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672976 2021-03-30T05:03:15.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672976' 2021-03-30T05:03:15.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:03:15.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:03:15.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542159 2021-03-30T05:03:15.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542159 2021-03-30T05:03:15.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836498 1-42949672976 2-60129542159' 2021-03-30T05:03:15.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:03:15.302 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836498 2021-03-30T05:03:15.302 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:03:15.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:03:15.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836498 2021-03-30T05:03:15.305 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:03:15.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836498 2021-03-30T05:03:15.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2021-03-30T05:03:15.307 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836498 2021-03-30T05:03:15.307 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:03:15.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836495 -lt 21474836498 2021-03-30T05:03:15.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:03:16.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:03:16.654 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:03:17.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836498 -lt 21474836498 2021-03-30T05:03:17.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:03:17.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672976 2021-03-30T05:03:17.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:03:17.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:03:17.015 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672976 2021-03-30T05:03:17.016 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:03:17.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672976 2021-03-30T05:03:17.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2021-03-30T05:03:17.017 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 42949672976 2021-03-30T05:03:17.018 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:03:17.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672976 -lt 42949672976 2021-03-30T05:03:17.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:03:17.368 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542159 2021-03-30T05:03:17.368 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:03:17.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:03:17.369 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542159 2021-03-30T05:03:17.370 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:03:17.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542159 2021-03-30T05:03:17.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542159' 2021-03-30T05:03:17.371 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 60129542159 2021-03-30T05:03:17.372 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:03:17.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542159 -lt 60129542159 2021-03-30T05:03:17.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:03:17.786 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: get_asok_path osd.0 2021-03-30T05:03:17.787 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:03:17.787 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:03:17.787 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:03:17.787 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:03:17.788 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:03:17.788 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-osd.0.asok 2021-03-30T05:03:17.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:03:17.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:63: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-osd.0.asok dump_osd_network 2021-03-30T05:03:17.874 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:03:17.874 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 1000, 2021-03-30T05:03:17.875 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:03:17.875 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:03:17.883 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:17.883 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:03:17.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:64: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:03:17.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:17.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: jq .threshold 2021-03-30T05:03:17.888 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:65: TEST_network_ping_test1: test 1000 = 1000 2021-03-30T05:03:17.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:03:17.890 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: get_asok_path mgr.x 2021-03-30T05:03:17.890 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2021-03-30T05:03:17.891 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2021-03-30T05:03:17.891 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:03:17.891 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:03:17.891 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:03:17.892 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mgr.x.asok 2021-03-30T05:03:17.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:03:17.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:67: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-mgr.x.asok dump_osd_network 2021-03-30T05:03:17.968 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:03:17.968 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 1000, 2021-03-30T05:03:17.969 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:03:17.969 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:03:17.976 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:17.977 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:03:17.978 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:68: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:03:17.979 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:17.980 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: jq .threshold 2021-03-30T05:03:17.981 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:69: TEST_network_ping_test1: test 1000 = 1000 2021-03-30T05:03:17.982 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:03:17.984 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: get_asok_path osd.0 2021-03-30T05:03:17.984 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:03:17.984 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:03:17.984 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:03:17.985 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:03:17.985 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:03:17.985 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-osd.0.asok 2021-03-30T05:03:17.985 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:03:17.986 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:71: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-osd.0.asok dump_osd_network 0 2021-03-30T05:03:18.071 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:03:18.072 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 0, 2021-03-30T05:03:18.072 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [ 2021-03-30T05:03:18.072 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.072 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:14 2021", 2021-03-30T05:03:18.073 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.073 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.073 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:03:18.073 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.074 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.074 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.316, 2021-03-30T05:03:18.074 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.310, 2021-03-30T05:03:18.074 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.318 2021-03-30T05:03:18.075 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.075 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.075 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.428, 2021-03-30T05:03:18.076 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.428, 2021-03-30T05:03:18.076 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.454 2021-03-30T05:03:18.076 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.077 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.077 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.428, 2021-03-30T05:03:18.077 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.428, 2021-03-30T05:03:18.078 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.454 2021-03-30T05:03:18.078 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.078 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.183 2021-03-30T05:03:18.078 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.079 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.079 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:14 2021", 2021-03-30T05:03:18.079 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.079 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.079 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:03:18.080 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.080 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.080 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.307, 2021-03-30T05:03:18.081 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.294, 2021-03-30T05:03:18.081 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.310 2021-03-30T05:03:18.081 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.081 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.082 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.401, 2021-03-30T05:03:18.082 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.417, 2021-03-30T05:03:18.082 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.452 2021-03-30T05:03:18.082 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.082 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.083 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.401, 2021-03-30T05:03:18.083 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.417, 2021-03-30T05:03:18.083 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.452 2021-03-30T05:03:18.084 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.084 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.172 2021-03-30T05:03:18.084 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.084 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.085 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:17 2021", 2021-03-30T05:03:18.085 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.085 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.086 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:03:18.086 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.086 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.086 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.239, 2021-03-30T05:03:18.087 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.286, 2021-03-30T05:03:18.087 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.303 2021-03-30T05:03:18.092 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.092 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.092 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.311, 2021-03-30T05:03:18.092 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.412, 2021-03-30T05:03:18.093 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.720 2021-03-30T05:03:18.093 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.093 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.094 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.311, 2021-03-30T05:03:18.094 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.412, 2021-03-30T05:03:18.094 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.720 2021-03-30T05:03:18.094 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.095 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.155 2021-03-30T05:03:18.095 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.095 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.095 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:17 2021", 2021-03-30T05:03:18.096 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.096 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.096 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:03:18.097 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.097 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.097 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.232, 2021-03-30T05:03:18.097 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.287, 2021-03-30T05:03:18.098 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.301 2021-03-30T05:03:18.098 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.098 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.099 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.305, 2021-03-30T05:03:18.099 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.414, 2021-03-30T05:03:18.099 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.743 2021-03-30T05:03:18.099 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.100 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.100 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.305, 2021-03-30T05:03:18.100 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.414, 2021-03-30T05:03:18.100 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.743 2021-03-30T05:03:18.101 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.101 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.144 2021-03-30T05:03:18.101 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:03:18.101 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:03:18.101 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:03:18.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:18.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:03:18.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:72: TEST_network_ping_test1: test 4 = 4 2021-03-30T05:03:18.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:18.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: jq .threshold 2021-03-30T05:03:18.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:73: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:03:18.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:03:18.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: get_asok_path mgr.x 2021-03-30T05:03:18.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2021-03-30T05:03:18.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2021-03-30T05:03:18.107 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:03:18.107 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:03:18.107 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:03:18.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mgr.x.asok 2021-03-30T05:03:18.108 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:03:18.108 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:75: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-mgr.x.asok dump_osd_network 0 2021-03-30T05:03:18.166 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:03:18.166 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 0, 2021-03-30T05:03:18.166 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [ 2021-03-30T05:03:18.166 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.167 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:13 2021", 2021-03-30T05:03:18.167 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.167 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:03:18.167 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:03:18.168 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.168 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.168 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.371, 2021-03-30T05:03:18.168 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.303, 2021-03-30T05:03:18.169 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.300 2021-03-30T05:03:18.169 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.169 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.169 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.304, 2021-03-30T05:03:18.170 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.202, 2021-03-30T05:03:18.170 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.202 2021-03-30T05:03:18.170 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.170 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.171 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.430, 2021-03-30T05:03:18.171 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.438, 2021-03-30T05:03:18.171 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.457 2021-03-30T05:03:18.171 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.172 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.261 2021-03-30T05:03:18.172 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.172 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.172 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:13 2021", 2021-03-30T05:03:18.172 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.173 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:03:18.173 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:03:18.173 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.173 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.173 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.366, 2021-03-30T05:03:18.174 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.291, 2021-03-30T05:03:18.174 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.296 2021-03-30T05:03:18.174 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.174 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.174 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.275, 2021-03-30T05:03:18.175 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.205, 2021-03-30T05:03:18.175 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.205 2021-03-30T05:03:18.175 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.175 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.176 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.444, 2021-03-30T05:03:18.176 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.444, 2021-03-30T05:03:18.176 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.445 2021-03-30T05:03:18.176 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.177 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.287 2021-03-30T05:03:18.177 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.177 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.177 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:13 2021", 2021-03-30T05:03:18.178 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.178 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:03:18.178 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:03:18.178 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.178 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.179 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.336, 2021-03-30T05:03:18.179 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.287, 2021-03-30T05:03:18.179 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.274 2021-03-30T05:03:18.179 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.180 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.180 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.256, 2021-03-30T05:03:18.180 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.193, 2021-03-30T05:03:18.180 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.181 2021-03-30T05:03:18.180 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.181 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.181 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.396, 2021-03-30T05:03:18.181 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.418, 2021-03-30T05:03:18.181 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.418 2021-03-30T05:03:18.182 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.182 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.230 2021-03-30T05:03:18.182 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.182 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.182 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:13 2021", 2021-03-30T05:03:18.183 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.183 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:03:18.183 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:03:18.183 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.183 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.184 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.334, 2021-03-30T05:03:18.184 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.283, 2021-03-30T05:03:18.184 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.276 2021-03-30T05:03:18.184 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.184 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.185 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.223, 2021-03-30T05:03:18.185 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.195, 2021-03-30T05:03:18.185 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.195 2021-03-30T05:03:18.185 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.185 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.186 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.417, 2021-03-30T05:03:18.186 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.417, 2021-03-30T05:03:18.186 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.428 2021-03-30T05:03:18.186 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.187 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.214 2021-03-30T05:03:18.187 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.187 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.187 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:13 2021", 2021-03-30T05:03:18.187 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.188 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:03:18.188 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:03:18.188 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.188 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.188 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.276, 2021-03-30T05:03:18.189 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.289, 2021-03-30T05:03:18.189 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.322 2021-03-30T05:03:18.189 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.189 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.190 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.246, 2021-03-30T05:03:18.190 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.201, 2021-03-30T05:03:18.190 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.201 2021-03-30T05:03:18.190 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.191 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.191 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.395, 2021-03-30T05:03:18.191 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.427, 2021-03-30T05:03:18.191 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.458 2021-03-30T05:03:18.191 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.192 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.230 2021-03-30T05:03:18.192 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.192 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.192 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:14 2021", 2021-03-30T05:03:18.193 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.193 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.193 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:03:18.193 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.193 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.194 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.316, 2021-03-30T05:03:18.194 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.310, 2021-03-30T05:03:18.194 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.318 2021-03-30T05:03:18.194 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.194 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.195 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.258, 2021-03-30T05:03:18.195 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.196, 2021-03-30T05:03:18.195 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.196 2021-03-30T05:03:18.195 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.195 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.196 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.428, 2021-03-30T05:03:18.196 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.428, 2021-03-30T05:03:18.196 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.454 2021-03-30T05:03:18.196 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.196 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.326 2021-03-30T05:03:18.197 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.197 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.197 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:13 2021", 2021-03-30T05:03:18.197 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.198 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:03:18.198 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:03:18.198 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.198 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.198 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.276, 2021-03-30T05:03:18.199 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.275, 2021-03-30T05:03:18.199 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.310 2021-03-30T05:03:18.199 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.199 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.200 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.243, 2021-03-30T05:03:18.200 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.194, 2021-03-30T05:03:18.200 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.189 2021-03-30T05:03:18.200 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.201 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.201 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.353, 2021-03-30T05:03:18.201 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.385, 2021-03-30T05:03:18.201 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.491 2021-03-30T05:03:18.202 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.202 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.237 2021-03-30T05:03:18.202 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.202 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.202 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:14 2021", 2021-03-30T05:03:18.203 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.203 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.203 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:03:18.203 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.203 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.204 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.307, 2021-03-30T05:03:18.204 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.294, 2021-03-30T05:03:18.204 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.310 2021-03-30T05:03:18.204 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.205 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.205 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.230, 2021-03-30T05:03:18.205 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.195, 2021-03-30T05:03:18.205 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.195 2021-03-30T05:03:18.205 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.206 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.206 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.401, 2021-03-30T05:03:18.206 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.417, 2021-03-30T05:03:18.206 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.452 2021-03-30T05:03:18.206 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.207 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.333 2021-03-30T05:03:18.207 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.207 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.207 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:12 2021", 2021-03-30T05:03:18.207 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.208 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.208 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:03:18.208 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.208 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.208 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.308, 2021-03-30T05:03:18.209 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.296, 2021-03-30T05:03:18.209 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.309 2021-03-30T05:03:18.209 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.210 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.210 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.248, 2021-03-30T05:03:18.211 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.188, 2021-03-30T05:03:18.211 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.169 2021-03-30T05:03:18.211 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.211 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.212 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.412, 2021-03-30T05:03:18.212 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.419, 2021-03-30T05:03:18.212 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.720 2021-03-30T05:03:18.212 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.213 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.311 2021-03-30T05:03:18.213 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.213 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.213 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:12 2021", 2021-03-30T05:03:18.213 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.214 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:03:18.214 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:03:18.214 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.214 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.215 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.303, 2021-03-30T05:03:18.215 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.299, 2021-03-30T05:03:18.215 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.307 2021-03-30T05:03:18.215 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.215 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.216 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.223, 2021-03-30T05:03:18.216 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.182, 2021-03-30T05:03:18.216 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.182 2021-03-30T05:03:18.217 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.217 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.217 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.391, 2021-03-30T05:03:18.217 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.441, 2021-03-30T05:03:18.218 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.743 2021-03-30T05:03:18.218 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.218 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.270 2021-03-30T05:03:18.218 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.218 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.219 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:16 2021", 2021-03-30T05:03:18.219 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.219 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:03:18.219 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:03:18.220 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:03:18.220 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.220 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.278, 2021-03-30T05:03:18.220 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.269, 2021-03-30T05:03:18.221 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.272 2021-03-30T05:03:18.221 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.222 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.222 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.226, 2021-03-30T05:03:18.222 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.200, 2021-03-30T05:03:18.223 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.178 2021-03-30T05:03:18.223 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.223 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.224 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.365, 2021-03-30T05:03:18.224 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.390, 2021-03-30T05:03:18.224 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.501 2021-03-30T05:03:18.224 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.224 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.248 2021-03-30T05:03:18.225 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.225 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:03:18.225 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:03:16 2021", 2021-03-30T05:03:18.225 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:03:18.225 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:03:18.226 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:03:18.226 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:03:18.226 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:03:18.226 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.275, 2021-03-30T05:03:18.226 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.261, 2021-03-30T05:03:18.227 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.255 2021-03-30T05:03:18.227 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.227 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:03:18.227 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.193, 2021-03-30T05:03:18.228 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.193, 2021-03-30T05:03:18.228 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.162 2021-03-30T05:03:18.228 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.228 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:03:18.228 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.385, 2021-03-30T05:03:18.229 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.388, 2021-03-30T05:03:18.229 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.455 2021-03-30T05:03:18.229 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:03:18.229 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.210 2021-03-30T05:03:18.229 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:03:18.230 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:03:18.230 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:03:18.231 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:18.231 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:03:18.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:76: TEST_network_ping_test1: test 12 = 12 2021-03-30T05:03:18.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:03:18.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: jq .threshold 2021-03-30T05:03:18.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:77: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:03:18.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:81: TEST_network_ping_test1: sleep 50 2021-03-30T05:04:08.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:82: TEST_network_ping_test1: flush_pg_stats 2021-03-30T05:04:08.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:04:08.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:04:08.547 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:04:08.548 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:04:08.548 INFO:tasks.workunit.client.0.smithi197.stderr:2' 2021-03-30T05:04:08.548 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:04:08.548 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:04:08.549 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:04:08.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836510 2021-03-30T05:04:08.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836510 2021-03-30T05:04:08.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836510' 2021-03-30T05:04:08.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:04:08.673 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:04:08.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672989 2021-03-30T05:04:08.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672989 2021-03-30T05:04:08.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836510 1-42949672989' 2021-03-30T05:04:08.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:04:08.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:04:08.920 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=60129542172 2021-03-30T05:04:08.920 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 60129542172 2021-03-30T05:04:08.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836510 1-42949672989 2-60129542172' 2021-03-30T05:04:08.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:04:08.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836510 2021-03-30T05:04:08.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:04:08.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:04:08.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836510 2021-03-30T05:04:08.925 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:04:08.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836510 2021-03-30T05:04:08.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2021-03-30T05:04:08.925 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836510 2021-03-30T05:04:08.926 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:04:09.275 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836508 -lt 21474836510 2021-03-30T05:04:09.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:04:10.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:04:10.277 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:04:10.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836511 -lt 21474836510 2021-03-30T05:04:10.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:04:10.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672989 2021-03-30T05:04:10.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:04:10.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:04:10.639 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672989 2021-03-30T05:04:10.640 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:04:10.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672989 2021-03-30T05:04:10.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672989' 2021-03-30T05:04:10.641 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 42949672989 2021-03-30T05:04:10.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:04:10.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672989 -lt 42949672989 2021-03-30T05:04:10.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:04:10.993 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-60129542172 2021-03-30T05:04:10.993 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:04:10.993 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:04:10.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-60129542172 2021-03-30T05:04:10.995 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:04:10.995 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=60129542172 2021-03-30T05:04:10.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 60129542172' 2021-03-30T05:04:10.996 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 60129542172 2021-03-30T05:04:10.997 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:04:11.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 60129542172 -lt 60129542172 2021-03-30T05:04:11.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:04:11.373 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: get_asok_path osd.0 2021-03-30T05:04:11.373 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:04:11.373 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:04:11.373 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:11.374 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:11.374 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:11.374 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-osd.0.asok 2021-03-30T05:04:11.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:04:11.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:83: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-osd.0.asok dump_osd_network 2021-03-30T05:04:11.459 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:04:11.460 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 1000, 2021-03-30T05:04:11.460 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:04:11.460 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:04:11.467 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.468 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:04:11.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:84: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:04:11.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: jq .threshold 2021-03-30T05:04:11.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:85: TEST_network_ping_test1: test 1000 = 1000 2021-03-30T05:04:11.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:04:11.475 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: get_asok_path mgr.x 2021-03-30T05:04:11.475 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2021-03-30T05:04:11.475 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2021-03-30T05:04:11.476 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:11.476 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:11.476 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:11.476 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mgr.x.asok 2021-03-30T05:04:11.477 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:04:11.477 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:87: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-mgr.x.asok dump_osd_network 2021-03-30T05:04:11.551 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:04:11.552 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 1000, 2021-03-30T05:04:11.552 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:04:11.552 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:04:11.559 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.560 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:04:11.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:88: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:04:11.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: jq .threshold 2021-03-30T05:04:11.565 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:89: TEST_network_ping_test1: test 1000 = 1000 2021-03-30T05:04:11.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:04:11.567 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: get_asok_path osd.0 2021-03-30T05:04:11.567 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:04:11.567 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:04:11.567 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:11.568 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:11.568 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:11.568 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-osd.0.asok 2021-03-30T05:04:11.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:04:11.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:91: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-osd.0.asok dump_osd_network 0 2021-03-30T05:04:11.654 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:04:11.654 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 0, 2021-03-30T05:04:11.654 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [ 2021-03-30T05:04:11.654 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.655 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:07 2021", 2021-03-30T05:04:11.655 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.655 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.655 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:04:11.656 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.656 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.656 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.316, 2021-03-30T05:04:11.656 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.302, 2021-03-30T05:04:11.657 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.289 2021-03-30T05:04:11.657 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.657 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.657 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.423, 2021-03-30T05:04:11.657 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.454, 2021-03-30T05:04:11.658 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.473 2021-03-30T05:04:11.658 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.658 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.658 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.423, 2021-03-30T05:04:11.659 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.454, 2021-03-30T05:04:11.659 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.473 2021-03-30T05:04:11.659 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.660 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.244 2021-03-30T05:04:11.660 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.660 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.661 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:09 2021", 2021-03-30T05:04:11.661 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.661 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.662 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:04:11.662 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.662 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.663 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.267, 2021-03-30T05:04:11.663 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.313, 2021-03-30T05:04:11.663 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.308 2021-03-30T05:04:11.664 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.664 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.664 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.353, 2021-03-30T05:04:11.664 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.438, 2021-03-30T05:04:11.664 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.439 2021-03-30T05:04:11.665 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.665 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.665 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.353, 2021-03-30T05:04:11.665 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.438, 2021-03-30T05:04:11.666 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.439 2021-03-30T05:04:11.666 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.666 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.211 2021-03-30T05:04:11.666 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.666 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.667 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:09 2021", 2021-03-30T05:04:11.667 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.667 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.667 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:04:11.668 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.668 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.668 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.277, 2021-03-30T05:04:11.668 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.312, 2021-03-30T05:04:11.668 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.301 2021-03-30T05:04:11.669 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.669 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.669 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.376, 2021-03-30T05:04:11.669 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.458, 2021-03-30T05:04:11.669 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.458 2021-03-30T05:04:11.670 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.670 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.670 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.376, 2021-03-30T05:04:11.670 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.458, 2021-03-30T05:04:11.670 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.458 2021-03-30T05:04:11.671 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.671 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.220 2021-03-30T05:04:11.671 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.671 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.672 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:07 2021", 2021-03-30T05:04:11.672 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.672 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.672 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:04:11.672 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.673 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.673 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.304, 2021-03-30T05:04:11.673 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.306, 2021-03-30T05:04:11.673 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.293 2021-03-30T05:04:11.674 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.674 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.674 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.411, 2021-03-30T05:04:11.674 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.435, 2021-03-30T05:04:11.674 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.435 2021-03-30T05:04:11.675 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.675 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.675 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.411, 2021-03-30T05:04:11.675 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.435, 2021-03-30T05:04:11.675 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.435 2021-03-30T05:04:11.676 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.676 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.201 2021-03-30T05:04:11.676 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:04:11.676 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:04:11.677 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:04:11.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:04:11.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:92: TEST_network_ping_test1: test 4 = 4 2021-03-30T05:04:11.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.680 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: jq .threshold 2021-03-30T05:04:11.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:93: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:04:11.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:04:11.680 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: get_asok_path mgr.x 2021-03-30T05:04:11.680 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2021-03-30T05:04:11.681 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2021-03-30T05:04:11.681 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:11.681 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:11.681 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:11.682 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mgr.x.asok 2021-03-30T05:04:11.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:04:11.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:95: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-mgr.x.asok dump_osd_network 0 2021-03-30T05:04:11.745 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:04:11.746 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 0, 2021-03-30T05:04:11.746 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [ 2021-03-30T05:04:11.747 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.747 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:03 2021", 2021-03-30T05:04:11.747 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.747 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:04:11.748 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:04:11.748 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.748 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.748 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.352, 2021-03-30T05:04:11.748 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.346, 2021-03-30T05:04:11.749 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.316 2021-03-30T05:04:11.749 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.749 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.749 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.234, 2021-03-30T05:04:11.749 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.234, 2021-03-30T05:04:11.750 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.201 2021-03-30T05:04:11.750 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.750 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.751 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.479, 2021-03-30T05:04:11.751 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.479, 2021-03-30T05:04:11.752 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.479 2021-03-30T05:04:11.752 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.753 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.359 2021-03-30T05:04:11.753 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.753 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.754 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:03 2021", 2021-03-30T05:04:11.754 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.754 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:04:11.754 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:04:11.755 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.755 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.756 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.344, 2021-03-30T05:04:11.756 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.341, 2021-03-30T05:04:11.756 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.306 2021-03-30T05:04:11.756 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.757 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.757 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.242, 2021-03-30T05:04:11.757 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.242, 2021-03-30T05:04:11.757 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.194 2021-03-30T05:04:11.758 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.758 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.758 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.458, 2021-03-30T05:04:11.758 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.458, 2021-03-30T05:04:11.759 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.458 2021-03-30T05:04:11.759 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.759 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.337 2021-03-30T05:04:11.759 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.759 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.760 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:08 2021", 2021-03-30T05:04:11.760 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.760 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:04:11.760 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:04:11.761 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.761 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.761 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.321, 2021-03-30T05:04:11.761 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.308, 2021-03-30T05:04:11.762 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.303 2021-03-30T05:04:11.762 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.762 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.762 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.251, 2021-03-30T05:04:11.763 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.232, 2021-03-30T05:04:11.763 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.165 2021-03-30T05:04:11.763 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.763 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.763 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.414, 2021-03-30T05:04:11.764 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.450, 2021-03-30T05:04:11.764 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.450 2021-03-30T05:04:11.764 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.764 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.272 2021-03-30T05:04:11.764 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.765 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.765 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:06 2021", 2021-03-30T05:04:11.765 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.765 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:04:11.766 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:04:11.766 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.766 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.766 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.303, 2021-03-30T05:04:11.766 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.321, 2021-03-30T05:04:11.767 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.300 2021-03-30T05:04:11.767 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.767 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.767 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.222, 2021-03-30T05:04:11.768 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.208, 2021-03-30T05:04:11.768 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.200 2021-03-30T05:04:11.768 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.769 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.769 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.444, 2021-03-30T05:04:11.769 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.444, 2021-03-30T05:04:11.769 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.444 2021-03-30T05:04:11.770 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.770 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.327 2021-03-30T05:04:11.770 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.770 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.770 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:06 2021", 2021-03-30T05:04:11.771 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.771 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 1, 2021-03-30T05:04:11.771 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:04:11.771 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.771 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.772 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.304, 2021-03-30T05:04:11.772 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.318, 2021-03-30T05:04:11.772 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.290 2021-03-30T05:04:11.772 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.773 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.773 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.235, 2021-03-30T05:04:11.773 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.210, 2021-03-30T05:04:11.774 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.185 2021-03-30T05:04:11.774 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.774 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.774 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.423, 2021-03-30T05:04:11.774 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.423, 2021-03-30T05:04:11.775 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.423 2021-03-30T05:04:11.775 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.775 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.375 2021-03-30T05:04:11.775 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.776 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.776 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:08 2021", 2021-03-30T05:04:11.776 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.776 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:04:11.776 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:04:11.777 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.777 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.778 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.310, 2021-03-30T05:04:11.778 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.317, 2021-03-30T05:04:11.779 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.314 2021-03-30T05:04:11.779 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.779 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.780 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.243, 2021-03-30T05:04:11.780 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.243, 2021-03-30T05:04:11.780 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.197 2021-03-30T05:04:11.780 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.781 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.781 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.406, 2021-03-30T05:04:11.781 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.460, 2021-03-30T05:04:11.781 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.460 2021-03-30T05:04:11.782 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.782 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.288 2021-03-30T05:04:11.782 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.782 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.782 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:07 2021", 2021-03-30T05:04:11.783 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.783 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.783 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:04:11.783 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.784 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.784 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.316, 2021-03-30T05:04:11.784 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.302, 2021-03-30T05:04:11.784 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.289 2021-03-30T05:04:11.784 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.785 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.785 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.215, 2021-03-30T05:04:11.785 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.203, 2021-03-30T05:04:11.785 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.144 2021-03-30T05:04:11.785 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.786 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.786 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.423, 2021-03-30T05:04:11.786 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.454, 2021-03-30T05:04:11.786 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.473 2021-03-30T05:04:11.787 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.787 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.245 2021-03-30T05:04:11.787 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.787 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.788 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:09 2021", 2021-03-30T05:04:11.788 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.788 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.788 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:04:11.788 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.789 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.789 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.267, 2021-03-30T05:04:11.789 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.313, 2021-03-30T05:04:11.789 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.308 2021-03-30T05:04:11.789 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.790 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.790 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.225, 2021-03-30T05:04:11.790 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.210, 2021-03-30T05:04:11.790 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.183 2021-03-30T05:04:11.790 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.791 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.791 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.353, 2021-03-30T05:04:11.791 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.438, 2021-03-30T05:04:11.791 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.439 2021-03-30T05:04:11.792 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.792 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.276 2021-03-30T05:04:11.792 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.792 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.792 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:09 2021", 2021-03-30T05:04:11.793 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.793 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.793 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 2, 2021-03-30T05:04:11.793 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.793 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.794 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.277, 2021-03-30T05:04:11.794 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.312, 2021-03-30T05:04:11.794 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.301 2021-03-30T05:04:11.794 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.795 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.795 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.212, 2021-03-30T05:04:11.795 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.212, 2021-03-30T05:04:11.795 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.172 2021-03-30T05:04:11.795 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.796 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.796 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.376, 2021-03-30T05:04:11.796 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.458, 2021-03-30T05:04:11.796 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.458 2021-03-30T05:04:11.797 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.797 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.283 2021-03-30T05:04:11.797 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.797 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.797 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:07 2021", 2021-03-30T05:04:11.798 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.798 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 0, 2021-03-30T05:04:11.798 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 1, 2021-03-30T05:04:11.798 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.798 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.799 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.304, 2021-03-30T05:04:11.799 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.306, 2021-03-30T05:04:11.799 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.293 2021-03-30T05:04:11.799 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.800 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.800 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.217, 2021-03-30T05:04:11.800 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.217, 2021-03-30T05:04:11.800 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.155 2021-03-30T05:04:11.800 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.801 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.801 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.411, 2021-03-30T05:04:11.801 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.435, 2021-03-30T05:04:11.802 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.435 2021-03-30T05:04:11.802 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.802 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.264 2021-03-30T05:04:11.803 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.803 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.804 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:08 2021", 2021-03-30T05:04:11.804 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.804 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:04:11.805 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:04:11.805 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "front", 2021-03-30T05:04:11.805 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.806 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.305, 2021-03-30T05:04:11.806 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.298, 2021-03-30T05:04:11.806 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.293 2021-03-30T05:04:11.807 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.807 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.807 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.233, 2021-03-30T05:04:11.808 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.213, 2021-03-30T05:04:11.808 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.195 2021-03-30T05:04:11.808 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.809 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.809 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.468, 2021-03-30T05:04:11.809 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.476, 2021-03-30T05:04:11.810 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.476 2021-03-30T05:04:11.810 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.811 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.247 2021-03-30T05:04:11.811 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.811 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:04:11.811 INFO:tasks.workunit.client.0.smithi197.stdout: "last update": "Tue Mar 30 05:04:08 2021", 2021-03-30T05:04:11.812 INFO:tasks.workunit.client.0.smithi197.stdout: "stale": false, 2021-03-30T05:04:11.812 INFO:tasks.workunit.client.0.smithi197.stdout: "from osd": 2, 2021-03-30T05:04:11.812 INFO:tasks.workunit.client.0.smithi197.stdout: "to osd": 0, 2021-03-30T05:04:11.812 INFO:tasks.workunit.client.0.smithi197.stdout: "interface": "back", 2021-03-30T05:04:11.813 INFO:tasks.workunit.client.0.smithi197.stdout: "average": { 2021-03-30T05:04:11.813 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.283, 2021-03-30T05:04:11.813 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.284, 2021-03-30T05:04:11.813 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.284 2021-03-30T05:04:11.813 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.814 INFO:tasks.workunit.client.0.smithi197.stdout: "min": { 2021-03-30T05:04:11.814 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.234, 2021-03-30T05:04:11.814 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.203, 2021-03-30T05:04:11.814 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.175 2021-03-30T05:04:11.814 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.815 INFO:tasks.workunit.client.0.smithi197.stdout: "max": { 2021-03-30T05:04:11.815 INFO:tasks.workunit.client.0.smithi197.stdout: "1min": 0.372, 2021-03-30T05:04:11.815 INFO:tasks.workunit.client.0.smithi197.stdout: "5min": 0.415, 2021-03-30T05:04:11.815 INFO:tasks.workunit.client.0.smithi197.stdout: "15min": 0.418 2021-03-30T05:04:11.816 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:04:11.816 INFO:tasks.workunit.client.0.smithi197.stdout: "last": 0.256 2021-03-30T05:04:11.816 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:04:11.816 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:04:11.816 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:04:11.818 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.819 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: jq '.entries | length' 2021-03-30T05:04:11.819 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:96: TEST_network_ping_test1: test 12 = 12 2021-03-30T05:04:11.820 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.820 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: jq .threshold 2021-03-30T05:04:11.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:97: TEST_network_ping_test1: test 0 = 0 2021-03-30T05:04:11.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:04:11.821 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: get_asok_path mgr.x 2021-03-30T05:04:11.821 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mgr.x 2021-03-30T05:04:11.822 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mgr.x ']' 2021-03-30T05:04:11.822 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:11.822 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:11.823 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:11.823 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mgr.x.asok 2021-03-30T05:04:11.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:04:11.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:100: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-mgr.x.asok dump_osd_network 99 2021-03-30T05:04:11.837 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:04:11.837 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 99, 2021-03-30T05:04:11.838 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:04:11.838 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:04:11.846 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.846 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: jq .threshold 2021-03-30T05:04:11.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:101: TEST_network_ping_test1: test 99 = 99 2021-03-30T05:04:11.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: tee td/network-ping/json 2021-03-30T05:04:11.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: get_asok_path osd.0 2021-03-30T05:04:11.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:04:11.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:04:11.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:11.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:11.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:11.852 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-osd.0.asok 2021-03-30T05:04:11.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: CEPH_ARGS= 2021-03-30T05:04:11.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:102: TEST_network_ping_test1: ceph daemon /tmp/ceph-asok.25988/ceph-osd.0.asok dump_osd_network 98 2021-03-30T05:04:11.937 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:04:11.937 INFO:tasks.workunit.client.0.smithi197.stdout: "threshold": 98, 2021-03-30T05:04:11.938 INFO:tasks.workunit.client.0.smithi197.stdout: "entries": [] 2021-03-30T05:04:11.938 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:04:11.945 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: cat td/network-ping/json 2021-03-30T05:04:11.945 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: jq .threshold 2021-03-30T05:04:11.947 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:103: TEST_network_ping_test1: test 98 = 98 2021-03-30T05:04:11.947 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:105: TEST_network_ping_test1: rm -f td/network-ping/json 2021-03-30T05:04:11.948 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:20: run: teardown td/network-ping 2021-03-30T05:04:11.948 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2021-03-30T05:04:11.949 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:04:11.949 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2021-03-30T05:04:11.950 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:04:11.950 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:04:11.951 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:04:11.951 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:04:11.951 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:04:12.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:04:12.057 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:04:12.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:04:12.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:04:12.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:04:12.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:04:12.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:04:12.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:04:12.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:04:12.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:04:12.061 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:04:12.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:04:12.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:04:12.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2021-03-30T05:04:12.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:04:12.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:12.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:12.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.25988 2021-03-30T05:04:12.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:04:12.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:04:12.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:17: run: for func in $funcs 2021-03-30T05:04:12.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:18: run: setup td/network-ping 2021-03-30T05:04:12.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/network-ping 2021-03-30T05:04:12.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/network-ping 2021-03-30T05:04:12.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2021-03-30T05:04:12.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:04:12.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2021-03-30T05:04:12.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:04:12.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:04:12.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:04:12.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:04:12.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:04:12.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:04:12.078 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:04:12.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:04:12.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:04:12.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:04:12.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:04:12.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:04:12.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:04:12.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:04:12.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:04:12.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:04:12.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:04:12.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:04:12.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2021-03-30T05:04:12.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:04:12.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:12.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:12.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.25988 2021-03-30T05:04:12.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:04:12.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:04:12.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/network-ping 2021-03-30T05:04:12.089 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:04:12.089 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:12.090 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:12.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.25988 2021-03-30T05:04:12.090 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:04:12.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:04:12.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:04:12.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/network-ping 1' TERM HUP INT 2021-03-30T05:04:12.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:19: run: TEST_network_ping_test2 td/network-ping 2021-03-30T05:04:12.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:111: TEST_network_ping_test2: local dir=td/network-ping 2021-03-30T05:04:12.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:113: TEST_network_ping_test2: export CEPH_ARGS 2021-03-30T05:04:12.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:114: TEST_network_ping_test2: export 'EXTRA_OPTS= --mon_warn_on_slow_ping_time=0.001' 2021-03-30T05:04:12.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:114: TEST_network_ping_test2: EXTRA_OPTS=' --mon_warn_on_slow_ping_time=0.001' 2021-03-30T05:04:12.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:115: TEST_network_ping_test2: run_mon td/network-ping a 2021-03-30T05:04:12.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/network-ping 2021-03-30T05:04:12.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:04:12.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:04:12.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:04:12.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/network-ping/a 2021-03-30T05:04:12.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/network-ping/a --run-dir=td/network-ping 2021-03-30T05:04:12.394 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:04:12.394 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:04:12.395 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:04:12.395 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:04:12.395 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:12.395 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:12.395 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:12.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --mon_warn_on_slow_ping_time=0.001 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/network-ping/a '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --mon-cluster-log-file=td/network-ping/log --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:04:12.586 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:04:12.588 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:04:12.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:04:12.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:04:12.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:04:12.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:04:12.589 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:04:12.590 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:04:12.590 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:04:12.590 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:12.590 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:12.591 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:12.591 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mon.a.asok 2021-03-30T05:04:12.591 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:04:12.591 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.25988/ceph-mon.a.asok config get fsid 2021-03-30T05:04:12.675 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:04:12.676 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:04:12.676 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:04:12.676 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:04:12.676 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:04:12.677 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:04:12.677 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:04:12.677 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:04:12.677 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:04:12.678 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:12.678 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:12.678 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.25988/ceph-mon.a.asok 2021-03-30T05:04:12.678 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:04:12.678 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.25988/ceph-mon.a.asok config get mon_host 2021-03-30T05:04:12.764 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:116: TEST_network_ping_test2: run_mgr td/network-ping x 2021-03-30T05:04:12.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/network-ping 2021-03-30T05:04:12.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:04:12.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:04:12.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:04:12.766 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/network-ping/x 2021-03-30T05:04:12.766 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:04:13.635 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:04:13.635 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:04:13.635 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:04:13.636 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:04:13.636 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:13.636 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:13.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:13.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:04:13.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --mon_warn_on_slow_ping_time=0.001 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/network-ping/x '--log-file=td/network-ping/$name.log' '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --run-dir=td/network-ping '--pid-file=td/network-ping/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:04:13.663 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:117: TEST_network_ping_test2: run_osd td/network-ping 0 2021-03-30T05:04:13.664 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/network-ping 2021-03-30T05:04:13.664 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:04:13.664 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:04:13.665 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:04:13.665 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/network-ping/0 2021-03-30T05:04:13.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2021-03-30T05:04:13.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:04:13.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:04:13.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:04:13.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/network-ping/0' 2021-03-30T05:04:13.668 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/network-ping/0/journal' 2021-03-30T05:04:13.668 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:04:13.668 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2021-03-30T05:04:13.669 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/network-ping' 2021-03-30T05:04:13.669 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:04:13.669 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:04:13.670 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:04:13.670 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:04:13.671 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:13.671 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:13.671 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:13.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:13.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:04:13.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:04:13.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:04:13.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2021-03-30T05:04:13.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2021-03-30T05:04:13.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:04:13.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:04:13.675 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:04:13.675 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:04:13.675 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:04:13.676 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/network-ping/0 2021-03-30T05:04:13.676 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:04:13.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e452cbfe-8aae-497a-83d5-b1d2e51fd7f5 2021-03-30T05:04:13.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 e452cbfe-8aae-497a-83d5-b1d2e51fd7f5' 2021-03-30T05:04:13.678 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 e452cbfe-8aae-497a-83d5-b1d2e51fd7f5 2021-03-30T05:04:13.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:04:13.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBNsWJgLv8rKBAAQ1HsHMOJmvErR0abwS6mxg== 2021-03-30T05:04:13.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBNsWJgLv8rKBAAQ1HsHMOJmvErR0abwS6mxg=="}' 2021-03-30T05:04:13.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e452cbfe-8aae-497a-83d5-b1d2e51fd7f5 -i td/network-ping/0/new.json 2021-03-30T05:04:14.000 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:04:14.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/network-ping/0/new.json 2021-03-30T05:04:14.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBNsWJgLv8rKBAAQ1HsHMOJmvErR0abwS6mxg== --osd-uuid e452cbfe-8aae-497a-83d5-b1d2e51fd7f5 2021-03-30T05:04:14.034 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.033+0000 7f74a8c81f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:14.036 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.035+0000 7f74a8c81f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:14.038 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.037+0000 7f74a8c81f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:14.038 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.038+0000 7f74a8c81f40 -1 bluestore(td/network-ping/0/block) _read_bdev_label failed to open td/network-ping/0/block: (2) No such file or directory 2021-03-30T05:04:14.039 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.038+0000 7f74a8c81f40 -1 bluestore(td/network-ping/0/block) _read_bdev_label failed to open td/network-ping/0/block: (2) No such file or directory 2021-03-30T05:04:14.039 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.038+0000 7f74a8c81f40 -1 bluestore(td/network-ping/0/block) _read_bdev_label failed to open td/network-ping/0/block: (2) No such file or directory 2021-03-30T05:04:14.086 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.085+0000 7f74a8c81f40 -1 bluestore(td/network-ping/0) _read_fsid unparsable uuid 2021-03-30T05:04:14.513 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:14.512+0000 7f74a8c81f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:04:17.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/network-ping/0/keyring 2021-03-30T05:04:17.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:04:17.057 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:04:17.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:04:17.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/network-ping/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:04:17.352 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:04:17.353 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:04:17.354 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/0 --osd-journal=td/network-ping/0/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:04:17.354 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:04:17.354 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:04:17.355 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:04:17.375 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:17.373+0000 7fa1de9cff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:17.377 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:17.375+0000 7fa1de9cff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:17.377 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:17.376+0000 7fa1de9cff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:17.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:04:17.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:04:17.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:04:17.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:04:17.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:04:17.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:04:17.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:04:17.728 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:04:17.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:04:17.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:04:17.898 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:17.896+0000 7fa1de9cff40 -1 Falling back to public interface 2021-03-30T05:04:18.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:04:18.670 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:18.668+0000 7fa1de9cff40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:04:19.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:04:19.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:04:19.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:04:19.104 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:04:19.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:04:19.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:04:19.532 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/28754,v1:127.0.0.1:6803/28754] [v2:127.0.0.1:6804/28754,v1:127.0.0.1:6805/28754] exists,up e452cbfe-8aae-497a-83d5-b1d2e51fd7f5 2021-03-30T05:04:19.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:04:19.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:04:19.537 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:04:19.537 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:118: TEST_network_ping_test2: run_osd td/network-ping 1 2021-03-30T05:04:19.537 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/network-ping 2021-03-30T05:04:19.537 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:04:19.537 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:04:19.538 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:04:19.538 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/network-ping/1 2021-03-30T05:04:19.538 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2021-03-30T05:04:19.538 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:04:19.539 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:04:19.539 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:04:19.539 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/network-ping/1' 2021-03-30T05:04:19.539 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/network-ping/1/journal' 2021-03-30T05:04:19.539 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:04:19.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2021-03-30T05:04:19.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/network-ping' 2021-03-30T05:04:19.540 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:04:19.540 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:04:19.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:04:19.541 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:04:19.541 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:19.541 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:19.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:19.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:19.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:04:19.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:04:19.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:04:19.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2021-03-30T05:04:19.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2021-03-30T05:04:19.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:04:19.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:04:19.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:04:19.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:04:19.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:04:19.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/network-ping/1 2021-03-30T05:04:19.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:04:19.545 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1ba9f985-5d87-4aea-90a7-af5e8158865e 2021-03-30T05:04:19.545 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 1ba9f985-5d87-4aea-90a7-af5e8158865e' 2021-03-30T05:04:19.545 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 1ba9f985-5d87-4aea-90a7-af5e8158865e 2021-03-30T05:04:19.546 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:04:19.549 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBTsWJgifqyIBAAd95CghpmPUySQ3lhZ0vBVA== 2021-03-30T05:04:19.549 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBTsWJgifqyIBAAd95CghpmPUySQ3lhZ0vBVA=="}' 2021-03-30T05:04:19.549 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1ba9f985-5d87-4aea-90a7-af5e8158865e -i td/network-ping/1/new.json 2021-03-30T05:04:20.079 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:04:20.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/network-ping/1/new.json 2021-03-30T05:04:20.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBTsWJgifqyIBAAd95CghpmPUySQ3lhZ0vBVA== --osd-uuid 1ba9f985-5d87-4aea-90a7-af5e8158865e 2021-03-30T05:04:20.112 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.111+0000 7f8d0054bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:20.114 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.112+0000 7f8d0054bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:20.116 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.114+0000 7f8d0054bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:20.116 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.115+0000 7f8d0054bf40 -1 bluestore(td/network-ping/1/block) _read_bdev_label failed to open td/network-ping/1/block: (2) No such file or directory 2021-03-30T05:04:20.117 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.115+0000 7f8d0054bf40 -1 bluestore(td/network-ping/1/block) _read_bdev_label failed to open td/network-ping/1/block: (2) No such file or directory 2021-03-30T05:04:20.117 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.115+0000 7f8d0054bf40 -1 bluestore(td/network-ping/1/block) _read_bdev_label failed to open td/network-ping/1/block: (2) No such file or directory 2021-03-30T05:04:20.170 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.169+0000 7f8d0054bf40 -1 bluestore(td/network-ping/1) _read_fsid unparsable uuid 2021-03-30T05:04:20.555 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:20.554+0000 7f8d0054bf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:04:23.296 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/network-ping/1/keyring 2021-03-30T05:04:23.296 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:04:23.297 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:04:23.297 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:04:23.298 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/network-ping/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:04:23.774 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:04:23.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:04:23.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/1 --osd-journal=td/network-ping/1/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:04:23.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:04:23.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:04:23.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:04:23.796 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:23.794+0000 7f80c9c12f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:23.797 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:23.796+0000 7f80c9c12f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:23.799 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:23.798+0000 7f80c9c12f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:24.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:04:24.128 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:04:24.128 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:04:24.128 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:04:24.129 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:04:24.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:04:24.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:04:24.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:04:24.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:04:24.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:04:24.322 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:24.321+0000 7f80c9c12f40 -1 Falling back to public interface 2021-03-30T05:04:24.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:04:25.061 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:25.059+0000 7f80c9c12f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:04:25.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:04:25.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:04:25.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:04:25.482 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:04:25.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:04:25.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:04:25.884 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/29117,v1:127.0.0.1:6811/29117] [v2:127.0.0.1:6812/29117,v1:127.0.0.1:6813/29117] exists,up 1ba9f985-5d87-4aea-90a7-af5e8158865e 2021-03-30T05:04:25.888 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:04:25.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:04:25.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:04:25.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:119: TEST_network_ping_test2: run_osd td/network-ping 2 2021-03-30T05:04:25.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/network-ping 2021-03-30T05:04:25.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:04:25.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2021-03-30T05:04:25.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:04:25.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/network-ping/2 2021-03-30T05:04:25.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 ' 2021-03-30T05:04:25.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:04:25.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:04:25.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:04:25.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/network-ping/2' 2021-03-30T05:04:25.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/network-ping/2/journal' 2021-03-30T05:04:25.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:04:25.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --mon_warn_on_slow_ping_time=0.001' 2021-03-30T05:04:25.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/network-ping' 2021-03-30T05:04:25.892 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:04:25.892 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:04:25.893 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:04:25.893 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:04:25.893 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:04:25.893 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:04:25.893 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:25.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' 2021-03-30T05:04:25.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:04:25.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:04:25.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:04:25.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/network-ping/$name.log' 2021-03-30T05:04:25.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/network-ping/$name.pid' 2021-03-30T05:04:25.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:04:25.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:04:25.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:04:25.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:04:25.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:04:25.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/network-ping/2 2021-03-30T05:04:25.896 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:04:25.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=00b62dea-3f51-46b6-bdcf-c23964d7c10f 2021-03-30T05:04:25.897 INFO:tasks.workunit.client.0.smithi197.stdout:add osd2 00b62dea-3f51-46b6-bdcf-c23964d7c10f 2021-03-30T05:04:25.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 00b62dea-3f51-46b6-bdcf-c23964d7c10f' 2021-03-30T05:04:25.898 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:04:25.901 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBZsWJgUiq3NRAAkVvtk98XQY0+zkyRXwR+7Q== 2021-03-30T05:04:25.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBZsWJgUiq3NRAAkVvtk98XQY0+zkyRXwR+7Q=="}' 2021-03-30T05:04:25.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 00b62dea-3f51-46b6-bdcf-c23964d7c10f -i td/network-ping/2/new.json 2021-03-30T05:04:26.451 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:04:26.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/network-ping/2/new.json 2021-03-30T05:04:26.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBZsWJgUiq3NRAAkVvtk98XQY0+zkyRXwR+7Q== --osd-uuid 00b62dea-3f51-46b6-bdcf-c23964d7c10f 2021-03-30T05:04:26.486 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.484+0000 7f8fae996f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:26.487 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.486+0000 7f8fae996f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:26.489 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.487+0000 7f8fae996f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:26.490 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.488+0000 7f8fae996f40 -1 bluestore(td/network-ping/2/block) _read_bdev_label failed to open td/network-ping/2/block: (2) No such file or directory 2021-03-30T05:04:26.490 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.488+0000 7f8fae996f40 -1 bluestore(td/network-ping/2/block) _read_bdev_label failed to open td/network-ping/2/block: (2) No such file or directory 2021-03-30T05:04:26.490 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.488+0000 7f8fae996f40 -1 bluestore(td/network-ping/2/block) _read_bdev_label failed to open td/network-ping/2/block: (2) No such file or directory 2021-03-30T05:04:26.528 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.527+0000 7f8fae996f40 -1 bluestore(td/network-ping/2) _read_fsid unparsable uuid 2021-03-30T05:04:26.947 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:26.946+0000 7f8fae996f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:04:29.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/network-ping/2/keyring 2021-03-30T05:04:29.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:04:29.589 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd2 key to auth repository 2021-03-30T05:04:29.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2021-03-30T05:04:29.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/network-ping/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:04:30.067 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:04:30.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2021-03-30T05:04:30.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=7fba1f4f-dde1-413a-8a96-c81ab95abb55 --auth-supported=none --mon-host=127.0.0.1:7146 --debug_disable_randomized_ping=true --debug_heartbeat_testing_span=5 --osd_heartbeat_interval=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/network-ping/2 --osd-journal=td/network-ping/2/journal --chdir= --mon_warn_on_slow_ping_time=0.001 --run-dir=td/network-ping '--admin-socket=/tmp/ceph-asok.25988/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/network-ping/$name.log' '--pid-file=td/network-ping/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:04:30.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:04:30.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:04:30.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:04:30.089 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:30.087+0000 7f53c5e65f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:30.091 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:30.089+0000 7f53c5e65f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:30.092 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:30.090+0000 7f53c5e65f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:04:30.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2021-03-30T05:04:30.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:04:30.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:04:30.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:04:30.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:04:30.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:04:30.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:04:30.433 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:04:30.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:04:30.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:04:30.610 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:30.608+0000 7f53c5e65f40 -1 Falling back to public interface 2021-03-30T05:04:30.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:04:31.404 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:04:31.403+0000 7f53c5e65f40 -1 osd.2 0 log_to_monitors {default=true} 2021-03-30T05:04:31.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:04:31.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:04:31.792 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:04:31.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:04:31.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:04:31.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:04:32.223 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/29472,v1:127.0.0.1:6819/29472] [v2:127.0.0.1:6820/29472,v1:127.0.0.1:6821/29472] exists,up 00b62dea-3f51-46b6-bdcf-c23964d7c10f 2021-03-30T05:04:32.224 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:04:32.224 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:04:32.225 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:04:32.225 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:121: TEST_network_ping_test2: sleep 5 2021-03-30T05:04:37.225 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:122: TEST_network_ping_test2: ceph osd crush add-bucket dc1 datacenter 2021-03-30T05:04:37.766 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'dc1' already exists 2021-03-30T05:04:37.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:123: TEST_network_ping_test2: ceph osd crush add-bucket dc2 datacenter 2021-03-30T05:04:38.331 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'dc2' already exists 2021-03-30T05:04:38.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:124: TEST_network_ping_test2: ceph osd crush add-bucket dc3 datacenter 2021-03-30T05:04:38.948 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'dc3' already exists 2021-03-30T05:04:38.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:125: TEST_network_ping_test2: ceph osd crush add-bucket rack1 rack 2021-03-30T05:04:39.544 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'rack1' already exists 2021-03-30T05:04:39.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:126: TEST_network_ping_test2: ceph osd crush add-bucket rack2 rack 2021-03-30T05:04:40.029 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'rack2' already exists 2021-03-30T05:04:40.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:127: TEST_network_ping_test2: ceph osd crush add-bucket rack3 rack 2021-03-30T05:04:40.536 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'rack3' already exists 2021-03-30T05:04:40.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:128: TEST_network_ping_test2: ceph osd crush add-bucket host1 host 2021-03-30T05:04:41.084 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'host1' already exists 2021-03-30T05:04:41.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:129: TEST_network_ping_test2: ceph osd crush add-bucket host2 host 2021-03-30T05:04:41.672 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'host2' already exists 2021-03-30T05:04:41.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:130: TEST_network_ping_test2: ceph osd crush add-bucket host3 host 2021-03-30T05:04:42.232 INFO:tasks.workunit.client.0.smithi197.stderr:bucket 'host3' already exists 2021-03-30T05:04:42.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:131: TEST_network_ping_test2: ceph osd crush move dc1 root=default 2021-03-30T05:04:42.847 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -5 name 'dc1' to location {root=default} in crush map 2021-03-30T05:04:42.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:132: TEST_network_ping_test2: ceph osd crush move dc2 root=default 2021-03-30T05:04:43.399 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -6 name 'dc2' to location {root=default} in crush map 2021-03-30T05:04:43.407 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:133: TEST_network_ping_test2: ceph osd crush move dc3 root=default 2021-03-30T05:04:43.951 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -7 name 'dc3' to location {root=default} in crush map 2021-03-30T05:04:43.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:134: TEST_network_ping_test2: ceph osd crush move rack1 datacenter=dc1 2021-03-30T05:04:44.469 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -8 name 'rack1' to location {datacenter=dc1} in crush map 2021-03-30T05:04:44.476 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:135: TEST_network_ping_test2: ceph osd crush move rack2 datacenter=dc2 2021-03-30T05:04:45.026 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -9 name 'rack2' to location {datacenter=dc2} in crush map 2021-03-30T05:04:45.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:136: TEST_network_ping_test2: ceph osd crush move rack3 datacenter=dc3 2021-03-30T05:04:45.603 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -10 name 'rack3' to location {datacenter=dc3} in crush map 2021-03-30T05:04:45.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:137: TEST_network_ping_test2: ceph osd crush move host1 rack=rack1 2021-03-30T05:04:46.355 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -11 name 'host1' to location {rack=rack1} in crush map 2021-03-30T05:04:46.363 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:138: TEST_network_ping_test2: ceph osd crush move host2 rack=rack2 2021-03-30T05:04:46.948 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -12 name 'host2' to location {rack=rack2} in crush map 2021-03-30T05:04:46.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:139: TEST_network_ping_test2: ceph osd crush move host3 rack=rack3 2021-03-30T05:04:47.457 INFO:tasks.workunit.client.0.smithi197.stderr:no need to move item id -13 name 'host3' to location {rack=rack3} in crush map 2021-03-30T05:04:47.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:140: TEST_network_ping_test2: ceph osd crush set osd.0 1.0 host=host1 2021-03-30T05:04:47.940 INFO:tasks.workunit.client.0.smithi197.stderr:set item id 0 name 'osd.0' weight 1 at location {host=host1}: no change 2021-03-30T05:04:47.948 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:141: TEST_network_ping_test2: ceph osd crush set osd.1 1.0 host=host2 2021-03-30T05:04:48.475 INFO:tasks.workunit.client.0.smithi197.stderr:set item id 1 name 'osd.1' weight 1 at location {host=host2}: no change 2021-03-30T05:04:48.483 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:142: TEST_network_ping_test2: ceph osd crush set osd.2 1.0 host=host3 2021-03-30T05:04:49.071 INFO:tasks.workunit.client.0.smithi197.stderr:set item id 2 name 'osd.2' weight 1 at location {host=host3}: no change 2021-03-30T05:04:49.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:143: TEST_network_ping_test2: ceph osd crush rule create-simple myrule default host firstn 2021-03-30T05:04:49.545 INFO:tasks.workunit.client.0.smithi197.stderr:rule myrule already exists 2021-03-30T05:04:49.553 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:145: TEST_network_ping_test2: create_pool foo 16 16 replicated myrule 2021-03-30T05:04:49.553 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create foo 16 16 replicated myrule 2021-03-30T05:04:50.371 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'foo' already exists 2021-03-30T05:04:50.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:04:51.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:148: TEST_network_ping_test2: timeout 20 rados bench -p foo 10 write -b 4096 --no-cleanup 2021-03-30T05:04:51.411 INFO:tasks.workunit.client.0.smithi197.stdout:hints = 1 2021-03-30T05:04:51.411 INFO:tasks.workunit.client.0.smithi197.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 10 seconds or 0 objects 2021-03-30T05:04:51.411 INFO:tasks.workunit.client.0.smithi197.stdout:Object prefix: benchmark_data_smithi197_30253 2021-03-30T05:04:51.412 INFO:tasks.workunit.client.0.smithi197.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2021-03-30T05:04:51.412 INFO:tasks.workunit.client.0.smithi197.stdout: 0 0 0 0 0 0 - 0 2021-03-30T05:04:52.411 INFO:tasks.workunit.client.0.smithi197.stdout: 1 16 64 48 0.187482 0.1875 0.277344 0.295707 2021-03-30T05:04:53.411 INFO:tasks.workunit.client.0.smithi197.stdout: 2 16 128 112 0.218729 0.25 0.306274 0.281299 2021-03-30T05:04:54.411 INFO:tasks.workunit.client.0.smithi197.stdout: 3 16 177 161 0.209615 0.191406 0.308702 0.280632 2021-03-30T05:04:55.411 INFO:tasks.workunit.client.0.smithi197.stdout: 4 16 240 224 0.218728 0.246094 0.201916 0.280066 2021-03-30T05:04:56.411 INFO:tasks.workunit.client.0.smithi197.stdout: 5 16 288 272 0.21248 0.1875 0.310347 0.286058 2021-03-30T05:04:57.411 INFO:tasks.workunit.client.0.smithi197.stdout: 6 16 337 321 0.208966 0.191406 0.263712 0.286335 2021-03-30T05:04:58.411 INFO:tasks.workunit.client.0.smithi197.stdout: 7 16 401 385 0.214825 0.25 0.255018 0.285975 2021-03-30T05:04:59.411 INFO:tasks.workunit.client.0.smithi197.stdout: 8 16 464 448 0.21873 0.246094 0.285249 0.283265 2021-03-30T05:05:00.412 INFO:tasks.workunit.client.0.smithi197.stdout: 9 16 513 497 0.215692 0.191406 0.233755 0.281439 2021-03-30T05:05:01.412 INFO:tasks.workunit.client.0.smithi197.stdout: 10 16 576 560 0.218729 0.246094 0.285016 0.282184 2021-03-30T05:05:02.412 INFO:tasks.workunit.client.0.smithi197.stdout:Total time run: 10.3019 2021-03-30T05:05:02.412 INFO:tasks.workunit.client.0.smithi197.stdout:Total writes made: 576 2021-03-30T05:05:02.413 INFO:tasks.workunit.client.0.smithi197.stdout:Write size: 4096 2021-03-30T05:05:02.413 INFO:tasks.workunit.client.0.smithi197.stdout:Object size: 4096 2021-03-30T05:05:02.413 INFO:tasks.workunit.client.0.smithi197.stdout:Bandwidth (MB/sec): 0.218407 2021-03-30T05:05:02.413 INFO:tasks.workunit.client.0.smithi197.stdout:Stddev Bandwidth: 0.0305366 2021-03-30T05:05:02.413 INFO:tasks.workunit.client.0.smithi197.stdout:Max bandwidth (MB/sec): 0.25 2021-03-30T05:05:02.414 INFO:tasks.workunit.client.0.smithi197.stdout:Min bandwidth (MB/sec): 0.1875 2021-03-30T05:05:02.414 INFO:tasks.workunit.client.0.smithi197.stdout:Average IOPS: 55 2021-03-30T05:05:02.414 INFO:tasks.workunit.client.0.smithi197.stdout:Stddev IOPS: 7.81736 2021-03-30T05:05:02.414 INFO:tasks.workunit.client.0.smithi197.stdout:Max IOPS: 64 2021-03-30T05:05:02.415 INFO:tasks.workunit.client.0.smithi197.stdout:Min IOPS: 48 2021-03-30T05:05:02.415 INFO:tasks.workunit.client.0.smithi197.stdout:Average Latency(s): 0.285841 2021-03-30T05:05:02.415 INFO:tasks.workunit.client.0.smithi197.stdout:Stddev Latency(s): 0.0377614 2021-03-30T05:05:02.415 INFO:tasks.workunit.client.0.smithi197.stdout:Max latency(s): 0.418876 2021-03-30T05:05:02.416 INFO:tasks.workunit.client.0.smithi197.stdout:Min latency(s): 0.200596 2021-03-30T05:05:02.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:151: TEST_network_ping_test2: sleep 10 2021-03-30T05:05:12.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:152: TEST_network_ping_test2: flush_pg_stats 2021-03-30T05:05:12.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:05:12.509 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:05:12.873 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:05:12.873 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:05:12.873 INFO:tasks.workunit.client.0.smithi197.stderr:2' 2021-03-30T05:05:12.874 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:05:12.874 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:05:12.874 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:05:12.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836493 2021-03-30T05:05:12.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836493 2021-03-30T05:05:12.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493' 2021-03-30T05:05:12.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:05:12.997 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:05:13.123 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672972 2021-03-30T05:05:13.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672972 2021-03-30T05:05:13.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493 1-42949672972' 2021-03-30T05:05:13.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:05:13.124 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:05:13.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=64424509451 2021-03-30T05:05:13.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 64424509451 2021-03-30T05:05:13.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-64424509451' 2021-03-30T05:05:13.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:05:13.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836493 2021-03-30T05:05:13.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:05:13.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:05:13.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836493 2021-03-30T05:05:13.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:05:13.275 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836493 2021-03-30T05:05:13.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836493 2021-03-30T05:05:13.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2021-03-30T05:05:13.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:05:13.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836493 -lt 21474836493 2021-03-30T05:05:13.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:05:13.625 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672972 2021-03-30T05:05:13.625 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:05:13.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:05:13.626 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672972 2021-03-30T05:05:13.626 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:05:13.627 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672972 2021-03-30T05:05:13.627 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2021-03-30T05:05:13.627 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 42949672972 2021-03-30T05:05:13.628 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:05:14.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672971 -lt 42949672972 2021-03-30T05:05:14.008 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:05:15.008 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:05:15.009 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:05:15.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672972 -lt 42949672972 2021-03-30T05:05:15.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:05:15.368 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-64424509451 2021-03-30T05:05:15.369 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:05:15.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:05:15.371 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-64424509451 2021-03-30T05:05:15.371 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:05:15.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=64424509451 2021-03-30T05:05:15.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 64424509451' 2021-03-30T05:05:15.373 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 64424509451 2021-03-30T05:05:15.373 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:05:15.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 64424509451 -lt 64424509451 2021-03-30T05:05:15.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:154: TEST_network_ping_test2: ceph health 2021-03-30T05:05:15.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:154: TEST_network_ping_test2: tee td/network-ping/health 2021-03-30T05:05:16.198 INFO:tasks.workunit.client.0.smithi197.stdout:HEALTH_WARN Slow OSD heartbeats on back (longest 0.363ms); Slow OSD heartbeats on front (longest 0.369ms); 1 pool(s) do not have an application enabled 2021-03-30T05:05:16.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:155: TEST_network_ping_test2: grep -q 'Slow OSD heartbeats' td/network-ping/health 2021-03-30T05:05:16.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:157: TEST_network_ping_test2: ceph health detail 2021-03-30T05:05:16.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:157: TEST_network_ping_test2: tee td/network-ping/health 2021-03-30T05:05:16.658 INFO:tasks.workunit.client.0.smithi197.stdout:HEALTH_WARN Slow OSD heartbeats on back (longest 0.363ms); Slow OSD heartbeats on front (longest 0.369ms); 1 pool(s) do not have an application enabled 2021-03-30T05:05:16.659 INFO:tasks.workunit.client.0.smithi197.stdout:[WRN] OSD_SLOW_PING_TIME_BACK: Slow OSD heartbeats on back (longest 0.363ms) 2021-03-30T05:05:16.659 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on back from osd.2 [dc3,rack3] to osd.1 [dc2,rack2] 0.363 msec 2021-03-30T05:05:16.659 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on back from osd.2 [dc3,rack3] to osd.0 [dc1,rack1] 0.358 msec 2021-03-30T05:05:16.659 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on back from osd.1 [dc2,rack2] to osd.2 [dc3,rack3] 0.309 msec 2021-03-30T05:05:16.660 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on back from osd.1 [dc2,rack2] to osd.0 [dc1,rack1] 0.298 msec 2021-03-30T05:05:16.660 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on back from osd.0 [dc1,rack1] to osd.1 [dc2,rack2] 0.278 msec possibly improving 2021-03-30T05:05:16.660 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on back from osd.0 [dc1,rack1] to osd.2 [dc3,rack3] 0.277 msec 2021-03-30T05:05:16.660 INFO:tasks.workunit.client.0.smithi197.stdout:[WRN] OSD_SLOW_PING_TIME_FRONT: Slow OSD heartbeats on front (longest 0.369ms) 2021-03-30T05:05:16.660 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on front from osd.2 [dc3,rack3] to osd.1 [dc2,rack2] 0.369 msec 2021-03-30T05:05:16.661 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on front from osd.2 [dc3,rack3] to osd.0 [dc1,rack1] 0.349 msec 2021-03-30T05:05:16.661 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on front from osd.1 [dc2,rack2] to osd.2 [dc3,rack3] 0.327 msec 2021-03-30T05:05:16.661 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on front from osd.1 [dc2,rack2] to osd.0 [dc1,rack1] 0.320 msec 2021-03-30T05:05:16.661 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on front from osd.0 [dc1,rack1] to osd.2 [dc3,rack3] 0.294 msec 2021-03-30T05:05:16.662 INFO:tasks.workunit.client.0.smithi197.stdout: Slow OSD heartbeats on front from osd.0 [dc1,rack1] to osd.1 [dc2,rack2] 0.272 msec possibly improving 2021-03-30T05:05:16.662 INFO:tasks.workunit.client.0.smithi197.stdout:[WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2021-03-30T05:05:16.662 INFO:tasks.workunit.client.0.smithi197.stdout: application not enabled on pool 'foo' 2021-03-30T05:05:16.662 INFO:tasks.workunit.client.0.smithi197.stdout: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2021-03-30T05:05:16.668 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:158: TEST_network_ping_test2: grep -q OSD_SLOW_PING_TIME_BACK td/network-ping/health 2021-03-30T05:05:16.669 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:159: TEST_network_ping_test2: grep -q OSD_SLOW_PING_TIME_FRONT td/network-ping/health 2021-03-30T05:05:16.670 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:160: TEST_network_ping_test2: grep -q 'Slow OSD heartbeats on front from osd[.][0-2] [[]dc[1-3],rack[1-3][]] to osd[.][0-2] [[]dc[1-3],rack[1-3][]]' td/network-ping/health 2021-03-30T05:05:16.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:162: TEST_network_ping_test2: rm -f td/network-ping/health 2021-03-30T05:05:16.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh:20: run: teardown td/network-ping 2021-03-30T05:05:16.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2021-03-30T05:05:16.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:05:16.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2021-03-30T05:05:16.673 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:05:16.673 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:05:16.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:05:16.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:05:16.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:05:16.779 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:05:16.780 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:05:16.780 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:05:16.781 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:05:16.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:05:16.782 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:05:16.782 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:05:16.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:16.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:05:16.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:05:16.784 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:16.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:05:16.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:05:16.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2021-03-30T05:05:16.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:05:16.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:16.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:05:16.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.25988 2021-03-30T05:05:16.839 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:05:16.839 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:05:16.839 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2021-03-30T05:05:16.839 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/network-ping 0 2021-03-30T05:05:16.840 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/network-ping 2021-03-30T05:05:16.840 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2021-03-30T05:05:16.840 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/network-ping KILL 2021-03-30T05:05:16.840 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:05:16.841 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:05:16.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:05:16.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:05:16.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:05:16.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:05:16.843 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:05:16.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:05:16.843 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:05:16.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:05:16.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:05:16.844 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:05:16.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:16.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:05:16.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:05:16.846 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:16.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:05:16.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2021-03-30T05:05:16.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/network-ping 2021-03-30T05:05:16.848 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:05:16.848 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:16.849 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.25988 2021-03-30T05:05:16.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.25988 2021-03-30T05:05:16.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:05:16.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:05:16.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2021-03-30T05:05:16.850 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-03-30T05:05:16.851 DEBUG:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-03-30T05:05:16.922 INFO:tasks.workunit:Running workunit misc/ok-to-stop.sh... 2021-03-30T05:05:16.923 DEBUG:teuthology.orchestra.run.smithi197:workunit test misc/ok-to-stop.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e4949d651265114d7b464cd1e8986d9a31a26071 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh 2021-03-30T05:05:16.983 INFO:tasks.workunit.client.0.smithi197.stderr:stty: 'standard input': Inappropriate ioctl for device 2021-03-30T05:05:16.992 INFO:tasks.workunit.client.0.smithi197.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2021-03-30T05:05:16.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2021-03-30T05:05:16.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2021-03-30T05:05:16.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2021-03-30T05:05:16.993 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2021-03-30T05:05:16.993 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2021-03-30T05:05:16.993 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2021-03-30T05:05:16.993 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2021-03-30T05:05:16.994 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2021-03-30T05:05:16.994 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/ok-to-stop 2021-03-30T05:05:16.994 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:6: run: local dir=td/ok-to-stop 2021-03-30T05:05:16.994 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:7: run: shift 2021-03-30T05:05:16.994 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:9: run: export CEPH_MON_A=127.0.0.1:7150 2021-03-30T05:05:16.995 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:9: run: CEPH_MON_A=127.0.0.1:7150 2021-03-30T05:05:16.995 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:10: run: export CEPH_MON_B=127.0.0.1:7151 2021-03-30T05:05:16.995 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:10: run: CEPH_MON_B=127.0.0.1:7151 2021-03-30T05:05:16.995 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:11: run: export CEPH_MON_C=127.0.0.1:7152 2021-03-30T05:05:16.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:11: run: CEPH_MON_C=127.0.0.1:7152 2021-03-30T05:05:16.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:12: run: export CEPH_MON_D=127.0.0.1:7153 2021-03-30T05:05:16.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:12: run: CEPH_MON_D=127.0.0.1:7153 2021-03-30T05:05:16.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:13: run: export CEPH_MON_E=127.0.0.1:7154 2021-03-30T05:05:16.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:13: run: CEPH_MON_E=127.0.0.1:7154 2021-03-30T05:05:16.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:14: run: export CEPH_ARGS 2021-03-30T05:05:16.997 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:15: run: uuidgen 2021-03-30T05:05:16.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:15: run: CEPH_ARGS+='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none ' 2021-03-30T05:05:16.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:16: run: export 'ORIG_CEPH_ARGS=--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none ' 2021-03-30T05:05:16.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:16: run: ORIG_CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none ' 2021-03-30T05:05:16.998 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: set 2021-03-30T05:05:16.998 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2021-03-30T05:05:17.002 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:18: run: local 'funcs=TEST_0_mds 2021-03-30T05:05:17.002 INFO:tasks.workunit.client.0.smithi197.stderr:TEST_0_osd 2021-03-30T05:05:17.002 INFO:tasks.workunit.client.0.smithi197.stderr:TEST_1_mon_checks 2021-03-30T05:05:17.002 INFO:tasks.workunit.client.0.smithi197.stderr:TEST_2_mons_checks 2021-03-30T05:05:17.003 INFO:tasks.workunit.client.0.smithi197.stderr:TEST_3_mons_checks 2021-03-30T05:05:17.003 INFO:tasks.workunit.client.0.smithi197.stderr:TEST_4_mons_checks 2021-03-30T05:05:17.003 INFO:tasks.workunit.client.0.smithi197.stderr:TEST_5_mons_checks' 2021-03-30T05:05:17.003 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2021-03-30T05:05:17.003 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2021-03-30T05:05:17.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2021-03-30T05:05:17.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2021-03-30T05:05:17.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:05:17.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:05:17.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:05:17.005 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:05:17.005 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:05:17.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:05:17.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:05:17.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:05:17.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:05:17.006 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:05:17.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:05:17.007 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:05:17.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:05:17.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:05:17.007 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:05:17.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:17.008 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:05:17.008 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:05:17.008 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:17.008 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:05:17.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:05:17.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:05:17.009 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:05:17.009 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:17.009 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:17.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:05:17.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:05:17.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:05:17.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2021-03-30T05:05:17.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:05:17.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:17.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:17.013 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30648 2021-03-30T05:05:17.014 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:05:17.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2021-03-30T05:05:17.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2021-03-30T05:05:17.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:05:17.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2021-03-30T05:05:17.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_0_mds td/ok-to-stop 2021-03-30T05:05:17.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:208: TEST_0_mds: local dir=td/ok-to-stop 2021-03-30T05:05:17.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:210: TEST_0_mds: CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:05:17.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:212: TEST_0_mds: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2021-03-30T05:05:17.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:05:17.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:05:17.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:05:17.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:05:17.017 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2021-03-30T05:05:17.017 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2021-03-30T05:05:17.314 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:05:17.315 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:17.315 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:17.315 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:17.316 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:17.316 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:17.316 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:17.316 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2021-03-30T05:05:17.467 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:05:17.469 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:05:17.469 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:05:17.469 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:05:17.469 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:05:17.470 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:05:17.470 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:05:17.470 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:05:17.470 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:05:17.471 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:05:17.471 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:17.471 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:17.471 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:05:17.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:05:17.472 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get fsid 2021-03-30T05:05:17.555 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:05:17.556 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:05:17.556 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:05:17.556 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:05:17.556 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:05:17.557 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:05:17.557 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:05:17.557 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:05:17.557 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:05:17.557 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:17.558 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:17.558 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:05:17.558 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:05:17.558 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get mon_host 2021-03-30T05:05:17.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:213: TEST_0_mds: run_mgr td/ok-to-stop x 2021-03-30T05:05:17.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ok-to-stop 2021-03-30T05:05:17.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:05:17.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:05:17.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:05:17.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ok-to-stop/x 2021-03-30T05:05:17.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:05:18.549 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:05:18.550 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:18.550 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:18.550 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:18.550 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:18.551 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:18.551 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:18.551 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:05:18.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ok-to-stop/x '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:05:18.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:214: TEST_0_mds: run_osd td/ok-to-stop 0 2021-03-30T05:05:18.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ok-to-stop 2021-03-30T05:05:18.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:05:18.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:05:18.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:05:18.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ok-to-stop/0 2021-03-30T05:05:18.575 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:05:18.575 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:05:18.575 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:05:18.575 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:05:18.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/0' 2021-03-30T05:05:18.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/0/journal' 2021-03-30T05:05:18.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:05:18.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:05:18.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2021-03-30T05:05:18.577 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:05:18.577 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:18.577 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:18.578 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:18.578 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:18.578 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:18.578 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:18.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:18.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:05:18.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:05:18.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:05:18.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2021-03-30T05:05:18.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2021-03-30T05:05:18.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:05:18.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:05:18.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:18.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:05:18.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:05:18.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ok-to-stop/0 2021-03-30T05:05:18.582 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:05:18.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=c6abcaa4-f624-43a6-b7cf-b5a97f1fb08b 2021-03-30T05:05:18.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 c6abcaa4-f624-43a6-b7cf-b5a97f1fb08b' 2021-03-30T05:05:18.583 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 c6abcaa4-f624-43a6-b7cf-b5a97f1fb08b 2021-03-30T05:05:18.583 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:05:18.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCOsWJgvYPUIhAABEGPTRah9Du0OyXYPC/obg== 2021-03-30T05:05:18.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCOsWJgvYPUIhAABEGPTRah9Du0OyXYPC/obg=="}' 2021-03-30T05:05:18.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new c6abcaa4-f624-43a6-b7cf-b5a97f1fb08b -i td/ok-to-stop/0/new.json 2021-03-30T05:05:18.905 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:05:18.914 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ok-to-stop/0/new.json 2021-03-30T05:05:18.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCOsWJgvYPUIhAABEGPTRah9Du0OyXYPC/obg== --osd-uuid c6abcaa4-f624-43a6-b7cf-b5a97f1fb08b 2021-03-30T05:05:18.936 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:18.935+0000 7fc7a09eff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:18.938 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:18.937+0000 7fc7a09eff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:18.939 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:18.939+0000 7fc7a09eff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:18.941 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:18.940+0000 7fc7a09eff40 -1 bluestore(td/ok-to-stop/0/block) _read_bdev_label failed to open td/ok-to-stop/0/block: (2) No such file or directory 2021-03-30T05:05:18.941 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:18.940+0000 7fc7a09eff40 -1 bluestore(td/ok-to-stop/0/block) _read_bdev_label failed to open td/ok-to-stop/0/block: (2) No such file or directory 2021-03-30T05:05:18.941 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:18.940+0000 7fc7a09eff40 -1 bluestore(td/ok-to-stop/0/block) _read_bdev_label failed to open td/ok-to-stop/0/block: (2) No such file or directory 2021-03-30T05:05:18.975 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:18.974+0000 7fc7a09eff40 -1 bluestore(td/ok-to-stop/0) _read_fsid unparsable uuid 2021-03-30T05:05:19.435 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:19.434+0000 7fc7a09eff40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:05:22.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ok-to-stop/0/keyring 2021-03-30T05:05:22.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:05:22.111 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:05:22.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:05:22.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ok-to-stop/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:05:22.359 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:05:22.360 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:05:22.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:22.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:05:22.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:05:22.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:05:22.378 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:22.377+0000 7fad18e9df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:22.380 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:22.379+0000 7fad18e9df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:22.382 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:22.381+0000 7fad18e9df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:22.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:05:22.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:05:22.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:05:22.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:05:22.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:05:22.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:05:22.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:05:22.732 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:05:22.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:05:22.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:05:22.898 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:22.897+0000 7fad18e9df40 -1 Falling back to public interface 2021-03-30T05:05:23.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:05:23.666 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:23.666+0000 7fad18e9df40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:05:24.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:05:24.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:05:24.084 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:05:24.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:05:24.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:05:24.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:05:24.448 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/31084,v1:127.0.0.1:6803/31084] [v2:127.0.0.1:6804/31084,v1:127.0.0.1:6805/31084] exists,up c6abcaa4-f624-43a6-b7cf-b5a97f1fb08b 2021-03-30T05:05:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:05:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:05:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:05:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:215: TEST_0_mds: run_mds td/ok-to-stop a 2021-03-30T05:05:24.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:578: run_mds: local dir=td/ok-to-stop 2021-03-30T05:05:24.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:579: run_mds: shift 2021-03-30T05:05:24.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:580: run_mds: local id=a 2021-03-30T05:05:24.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:581: run_mds: shift 2021-03-30T05:05:24.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:582: run_mds: local data=td/ok-to-stop/a 2021-03-30T05:05:24.454 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:585: run_mds: get_asok_path 2021-03-30T05:05:24.454 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:24.454 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:24.455 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:24.455 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:24.455 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:24.455 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:24.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:585: run_mds: ceph-mds --id a --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' 2021-03-30T05:05:24.468 INFO:tasks.workunit.client.0.smithi197.stdout:starting mds.a at 2021-03-30T05:05:24.471 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:217: TEST_0_mds: ceph osd pool create meta 1 2021-03-30T05:05:25.020 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'meta' already exists 2021-03-30T05:05:25.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:218: TEST_0_mds: ceph osd pool create data 1 2021-03-30T05:05:25.689 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'data' already exists 2021-03-30T05:05:25.696 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:219: TEST_0_mds: ceph fs new myfs meta data 2021-03-30T05:05:26.375 INFO:tasks.workunit.client.0.smithi197.stderr:filesystem 'myfs' already exists 2021-03-30T05:05:26.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:220: TEST_0_mds: sleep 5 2021-03-30T05:05:31.384 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:222: TEST_0_mds: ceph mds ok-to-stop a 2021-03-30T05:05:31.690 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4119 and/or standby gids 2021-03-30T05:05:31.691 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:223: TEST_0_mds: ceph mds ok-to-stop a dne 2021-03-30T05:05:31.991 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4119 and/or standby gids 2021-03-30T05:05:31.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:224: TEST_0_mds: ceph mds ok-to-stop dne 2021-03-30T05:05:32.456 INFO:tasks.workunit.client.0.smithi197.stderr:should be safe to stop [dne] 2021-03-30T05:05:32.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:226: TEST_0_mds: run_mds td/ok-to-stop b 2021-03-30T05:05:32.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:578: run_mds: local dir=td/ok-to-stop 2021-03-30T05:05:32.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:579: run_mds: shift 2021-03-30T05:05:32.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:580: run_mds: local id=b 2021-03-30T05:05:32.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:581: run_mds: shift 2021-03-30T05:05:32.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:582: run_mds: local data=td/ok-to-stop/b 2021-03-30T05:05:32.466 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:585: run_mds: get_asok_path 2021-03-30T05:05:32.466 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:32.467 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:32.467 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:32.467 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:32.467 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:32.468 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:32.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:585: run_mds: ceph-mds --id b --debug-mds 20 --debug-objecter 20 --debug-ms 20 --chdir= --mds-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' 2021-03-30T05:05:32.484 INFO:tasks.workunit.client.0.smithi197.stdout:starting mds.b at 2021-03-30T05:05:32.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:227: TEST_0_mds: sleep 5 2021-03-30T05:05:37.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:229: TEST_0_mds: ceph mds ok-to-stop a 2021-03-30T05:05:37.960 INFO:tasks.workunit.client.0.smithi197.stderr:should be safe to stop [a] 2021-03-30T05:05:37.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:230: TEST_0_mds: ceph mds ok-to-stop b 2021-03-30T05:05:38.429 INFO:tasks.workunit.client.0.smithi197.stderr:should be safe to stop [b] 2021-03-30T05:05:38.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:231: TEST_0_mds: ceph mds ok-to-stop a b 2021-03-30T05:05:38.736 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4119 and/or standby gids 4133 2021-03-30T05:05:38.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:232: TEST_0_mds: ceph mds ok-to-stop a dne1 dne2 2021-03-30T05:05:39.199 INFO:tasks.workunit.client.0.smithi197.stderr:should be safe to stop [a,dne1,dne2] 2021-03-30T05:05:39.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:233: TEST_0_mds: ceph mds ok-to-stop b dne 2021-03-30T05:05:39.663 INFO:tasks.workunit.client.0.smithi197.stderr:should be safe to stop [b,dne] 2021-03-30T05:05:39.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:234: TEST_0_mds: ceph mds ok-to-stop a b dne 2021-03-30T05:05:39.968 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: insufficent standby MDS daemons to stop active gids 4119 and/or standby gids 4133 2021-03-30T05:05:39.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:235: TEST_0_mds: ceph mds ok-to-stop dne1 dne2 2021-03-30T05:05:40.428 INFO:tasks.workunit.client.0.smithi197.stderr:should be safe to stop [dne1,dne2] 2021-03-30T05:05:40.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:237: TEST_0_mds: kill_daemons td/ok-to-stop KILL mds.a 2021-03-30T05:05:40.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:05:40.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:05:40.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:05:40.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:05:40.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:05:40.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:05:40.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2021-03-30T05:05:40.543 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:05:40.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:05:40.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:05:40.545 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:05:40.545 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:05:40.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:05:40.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2021-03-30T05:05:40.650 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:05:40.650 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:05:40.650 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:05:40.650 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:05:40.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:05:40.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:05:40.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:05:40.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:05:40.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:05:40.654 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:05:40.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:05:40.655 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:05:40.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:05:40.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:05:40.656 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:05:40.658 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:40.658 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:05:40.658 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:05:40.658 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:40.659 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:05:40.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:05:40.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:05:40.662 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:05:40.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:40.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:40.663 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:05:40.665 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:05:40.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:05:40.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2021-03-30T05:05:40.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2021-03-30T05:05:40.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2021-03-30T05:05:40.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2021-03-30T05:05:40.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:05:40.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:05:40.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:05:40.668 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:05:40.668 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:05:40.668 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:05:40.668 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:05:40.669 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:05:40.669 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:05:40.669 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:05:40.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:05:40.671 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:05:40.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:05:40.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:05:40.672 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:05:40.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:40.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:05:40.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:05:40.673 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:05:40.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:05:40.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:05:40.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:05:40.677 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:05:40.677 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:40.677 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:40.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:05:40.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:05:40.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:05:40.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2021-03-30T05:05:40.678 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:05:40.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:40.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:40.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30648 2021-03-30T05:05:40.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:05:40.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:05:40.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:05:40.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2021-03-30T05:05:40.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_0_osd td/ok-to-stop 2021-03-30T05:05:40.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:241: TEST_0_osd: local dir=td/ok-to-stop 2021-03-30T05:05:40.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:243: TEST_0_osd: CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:05:40.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:245: TEST_0_osd: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2021-03-30T05:05:40.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:05:40.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:05:40.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:05:40.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:05:40.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2021-03-30T05:05:40.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2021-03-30T05:05:40.935 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:05:40.935 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:40.935 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:40.936 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:40.936 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:40.936 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:40.936 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:40.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2021-03-30T05:05:41.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:05:41.129 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:05:41.130 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:05:41.130 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:05:41.130 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:05:41.130 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:05:41.130 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:05:41.131 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:05:41.131 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:05:41.131 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:05:41.132 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:41.132 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:41.132 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:05:41.132 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:05:41.132 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get fsid 2021-03-30T05:05:41.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:05:41.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:05:41.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:05:41.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:05:41.219 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:05:41.219 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:05:41.219 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:05:41.219 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:05:41.220 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:05:41.220 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:41.220 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:41.220 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:05:41.221 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:05:41.221 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get mon_host 2021-03-30T05:05:41.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:246: TEST_0_osd: run_mgr td/ok-to-stop x 2021-03-30T05:05:41.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ok-to-stop 2021-03-30T05:05:41.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:05:41.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:05:41.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:05:41.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ok-to-stop/x 2021-03-30T05:05:41.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:05:42.166 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:05:42.166 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:42.167 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:42.167 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:42.167 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:42.167 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:42.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:42.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:05:42.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ok-to-stop/x '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:05:42.190 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:247: TEST_0_osd: run_osd td/ok-to-stop 0 2021-03-30T05:05:42.190 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ok-to-stop 2021-03-30T05:05:42.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:05:42.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:05:42.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:05:42.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ok-to-stop/0 2021-03-30T05:05:42.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:05:42.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:05:42.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:05:42.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:05:42.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/0' 2021-03-30T05:05:42.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/0/journal' 2021-03-30T05:05:42.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:05:42.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:05:42.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2021-03-30T05:05:42.193 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:05:42.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:42.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:42.194 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:42.194 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:42.195 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:42.195 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:42.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:42.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:05:42.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:05:42.196 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:05:42.196 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2021-03-30T05:05:42.196 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2021-03-30T05:05:42.196 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:05:42.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:05:42.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:42.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:05:42.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:05:42.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ok-to-stop/0 2021-03-30T05:05:42.198 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:05:42.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0eb9e8ba-0953-4f70-b4ae-72dd5f11dceb 2021-03-30T05:05:42.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 0eb9e8ba-0953-4f70-b4ae-72dd5f11dceb' 2021-03-30T05:05:42.198 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 0eb9e8ba-0953-4f70-b4ae-72dd5f11dceb 2021-03-30T05:05:42.199 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:05:42.202 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCmsWJg+UIKDBAAve2Wv7kXlG3iqO9O2Voc8A== 2021-03-30T05:05:42.203 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCmsWJg+UIKDBAAve2Wv7kXlG3iqO9O2Voc8A=="}' 2021-03-30T05:05:42.203 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0eb9e8ba-0953-4f70-b4ae-72dd5f11dceb -i td/ok-to-stop/0/new.json 2021-03-30T05:05:42.516 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:05:42.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ok-to-stop/0/new.json 2021-03-30T05:05:42.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCmsWJg+UIKDBAAve2Wv7kXlG3iqO9O2Voc8A== --osd-uuid 0eb9e8ba-0953-4f70-b4ae-72dd5f11dceb 2021-03-30T05:05:42.548 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:42.546+0000 7f3054d6ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:42.550 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:42.549+0000 7f3054d6ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:42.552 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:42.550+0000 7f3054d6ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:42.552 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:42.550+0000 7f3054d6ff40 -1 bluestore(td/ok-to-stop/0/block) _read_bdev_label failed to open td/ok-to-stop/0/block: (2) No such file or directory 2021-03-30T05:05:42.552 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:42.550+0000 7f3054d6ff40 -1 bluestore(td/ok-to-stop/0/block) _read_bdev_label failed to open td/ok-to-stop/0/block: (2) No such file or directory 2021-03-30T05:05:42.553 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:42.550+0000 7f3054d6ff40 -1 bluestore(td/ok-to-stop/0/block) _read_bdev_label failed to open td/ok-to-stop/0/block: (2) No such file or directory 2021-03-30T05:05:42.594 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:42.592+0000 7f3054d6ff40 -1 bluestore(td/ok-to-stop/0) _read_fsid unparsable uuid 2021-03-30T05:05:43.013 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:43.011+0000 7f3054d6ff40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:05:45.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ok-to-stop/0/keyring 2021-03-30T05:05:45.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:05:45.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:05:45.590 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:05:45.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ok-to-stop/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:05:45.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:05:45.831 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:05:45.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/0 --osd-journal=td/ok-to-stop/0/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:45.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:05:45.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:05:45.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:05:45.849 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:45.847+0000 7f759b916f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:45.879 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:45.877+0000 7f759b916f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:45.879 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:45.878+0000 7f759b916f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:46.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:05:46.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:05:46.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:05:46.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:05:46.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:05:46.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:05:46.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:05:46.183 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:05:46.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:05:46.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:05:46.400 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:46.398+0000 7f759b916f40 -1 Falling back to public interface 2021-03-30T05:05:46.529 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:05:47.168 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:47.166+0000 7f759b916f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:05:47.531 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:05:47.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:05:47.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:05:47.533 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:05:47.534 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:05:47.534 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:05:47.887 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/32145,v1:127.0.0.1:6803/32145] [v2:127.0.0.1:6804/32145,v1:127.0.0.1:6805/32145] exists,up 0eb9e8ba-0953-4f70-b4ae-72dd5f11dceb 2021-03-30T05:05:47.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:05:47.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:05:47.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:05:47.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:248: TEST_0_osd: run_osd td/ok-to-stop 1 2021-03-30T05:05:47.893 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ok-to-stop 2021-03-30T05:05:47.893 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:05:47.893 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:05:47.893 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:05:47.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ok-to-stop/1 2021-03-30T05:05:47.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:05:47.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:05:47.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:05:47.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:05:47.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/1' 2021-03-30T05:05:47.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/1/journal' 2021-03-30T05:05:47.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:05:47.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:05:47.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2021-03-30T05:05:47.896 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:05:47.896 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:47.896 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:47.897 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:47.897 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:47.897 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:47.897 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:47.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:47.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:05:47.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:05:47.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:05:47.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2021-03-30T05:05:47.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2021-03-30T05:05:47.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:05:47.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:05:47.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:47.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:05:47.900 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:05:47.900 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ok-to-stop/1 2021-03-30T05:05:47.900 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:05:47.900 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=dd295e2d-52ba-4f17-9d83-b2bc3e46208e 2021-03-30T05:05:47.901 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 dd295e2d-52ba-4f17-9d83-b2bc3e46208e 2021-03-30T05:05:47.901 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 dd295e2d-52ba-4f17-9d83-b2bc3e46208e' 2021-03-30T05:05:47.902 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:05:47.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCrsWJgeKzLNRAAsS6ucztRbuXOI5rNjJjwtw== 2021-03-30T05:05:47.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCrsWJgeKzLNRAAsS6ucztRbuXOI5rNjJjwtw=="}' 2021-03-30T05:05:47.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new dd295e2d-52ba-4f17-9d83-b2bc3e46208e -i td/ok-to-stop/1/new.json 2021-03-30T05:05:48.385 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:05:48.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ok-to-stop/1/new.json 2021-03-30T05:05:48.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/1 --osd-journal=td/ok-to-stop/1/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCrsWJgeKzLNRAAsS6ucztRbuXOI5rNjJjwtw== --osd-uuid dd295e2d-52ba-4f17-9d83-b2bc3e46208e 2021-03-30T05:05:48.416 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.414+0000 7fec707cbf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:48.417 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.416+0000 7fec707cbf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:48.419 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.417+0000 7fec707cbf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:48.420 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.418+0000 7fec707cbf40 -1 bluestore(td/ok-to-stop/1/block) _read_bdev_label failed to open td/ok-to-stop/1/block: (2) No such file or directory 2021-03-30T05:05:48.420 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.418+0000 7fec707cbf40 -1 bluestore(td/ok-to-stop/1/block) _read_bdev_label failed to open td/ok-to-stop/1/block: (2) No such file or directory 2021-03-30T05:05:48.420 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.418+0000 7fec707cbf40 -1 bluestore(td/ok-to-stop/1/block) _read_bdev_label failed to open td/ok-to-stop/1/block: (2) No such file or directory 2021-03-30T05:05:48.459 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.458+0000 7fec707cbf40 -1 bluestore(td/ok-to-stop/1) _read_fsid unparsable uuid 2021-03-30T05:05:48.979 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:48.978+0000 7fec707cbf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:05:51.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ok-to-stop/1/keyring 2021-03-30T05:05:51.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:05:51.895 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:05:51.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:05:51.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ok-to-stop/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:05:52.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:05:52.372 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:05:52.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/1 --osd-journal=td/ok-to-stop/1/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:52.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:05:52.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:05:52.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:05:52.390 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:52.388+0000 7f4eb811ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:52.391 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:52.390+0000 7f4eb811ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:52.392 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:52.391+0000 7f4eb811ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:52.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:05:52.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:05:52.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:05:52.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:05:52.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:05:52.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:05:52.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:05:52.727 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:05:52.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:05:52.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:05:52.908 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:52.906+0000 7f4eb811ef40 -1 Falling back to public interface 2021-03-30T05:05:53.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:05:53.659 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:53.658+0000 7f4eb811ef40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:05:54.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:05:54.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:05:54.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:05:54.076 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:05:54.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:05:54.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:05:54.452 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/32500,v1:127.0.0.1:6811/32500] [v2:127.0.0.1:6812/32500,v1:127.0.0.1:6813/32500] exists,up dd295e2d-52ba-4f17-9d83-b2bc3e46208e 2021-03-30T05:05:54.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:05:54.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:05:54.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:05:54.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:249: TEST_0_osd: run_osd td/ok-to-stop 2 2021-03-30T05:05:54.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ok-to-stop 2021-03-30T05:05:54.463 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:05:54.463 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2021-03-30T05:05:54.464 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:05:54.464 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ok-to-stop/2 2021-03-30T05:05:54.464 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:05:54.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:05:54.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:05:54.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:05:54.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/2' 2021-03-30T05:05:54.467 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/2/journal' 2021-03-30T05:05:54.467 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:05:54.467 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:05:54.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2021-03-30T05:05:54.468 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:05:54.469 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:05:54.469 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:05:54.470 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:05:54.470 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:05:54.471 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:05:54.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:54.471 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:05:54.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:05:54.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:05:54.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:05:54.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2021-03-30T05:05:54.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2021-03-30T05:05:54.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:05:54.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:05:54.475 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:54.475 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:05:54.475 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:05:54.476 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ok-to-stop/2 2021-03-30T05:05:54.476 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:05:54.477 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=09737ee9-281c-40ba-87ee-acc0e2d749dc 2021-03-30T05:05:54.477 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 09737ee9-281c-40ba-87ee-acc0e2d749dc' 2021-03-30T05:05:54.478 INFO:tasks.workunit.client.0.smithi197.stdout:add osd2 09737ee9-281c-40ba-87ee-acc0e2d749dc 2021-03-30T05:05:54.480 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:05:54.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCysWJgJzDZGxAAc42Xrl4hsnUkCFOBj27WEQ== 2021-03-30T05:05:54.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCysWJgJzDZGxAAc42Xrl4hsnUkCFOBj27WEQ=="}' 2021-03-30T05:05:54.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 09737ee9-281c-40ba-87ee-acc0e2d749dc -i td/ok-to-stop/2/new.json 2021-03-30T05:05:54.885 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:05:54.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ok-to-stop/2/new.json 2021-03-30T05:05:54.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/2 --osd-journal=td/ok-to-stop/2/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCysWJgJzDZGxAAc42Xrl4hsnUkCFOBj27WEQ== --osd-uuid 09737ee9-281c-40ba-87ee-acc0e2d749dc 2021-03-30T05:05:54.916 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:54.915+0000 7f12538c5f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:54.917 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:54.917+0000 7f12538c5f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:54.919 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:54.918+0000 7f12538c5f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:54.919 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:54.919+0000 7f12538c5f40 -1 bluestore(td/ok-to-stop/2/block) _read_bdev_label failed to open td/ok-to-stop/2/block: (2) No such file or directory 2021-03-30T05:05:54.920 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:54.919+0000 7f12538c5f40 -1 bluestore(td/ok-to-stop/2/block) _read_bdev_label failed to open td/ok-to-stop/2/block: (2) No such file or directory 2021-03-30T05:05:54.920 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:54.919+0000 7f12538c5f40 -1 bluestore(td/ok-to-stop/2/block) _read_bdev_label failed to open td/ok-to-stop/2/block: (2) No such file or directory 2021-03-30T05:05:54.960 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:54.959+0000 7f12538c5f40 -1 bluestore(td/ok-to-stop/2) _read_fsid unparsable uuid 2021-03-30T05:05:55.362 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:55.362+0000 7f12538c5f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:05:58.012 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ok-to-stop/2/keyring 2021-03-30T05:05:58.012 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:05:58.013 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd2 key to auth repository 2021-03-30T05:05:58.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2021-03-30T05:05:58.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ok-to-stop/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:05:58.491 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:05:58.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2021-03-30T05:05:58.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:05:58.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/2 --osd-journal=td/ok-to-stop/2/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:05:58.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:05:58.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:05:58.510 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:58.509+0000 7f7464860f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:58.511 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:58.511+0000 7f7464860f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:58.513 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:58.513+0000 7f7464860f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:05:58.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2021-03-30T05:05:58.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:05:58.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:05:58.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:05:58.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:05:58.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:05:58.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:05:58.845 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:05:58.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:05:58.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:05:59.030 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:59.029+0000 7f7464860f40 -1 Falling back to public interface 2021-03-30T05:05:59.200 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:05:59.820 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:05:59.819+0000 7f7464860f40 -1 osd.2 0 log_to_monitors {default=true} 2021-03-30T05:06:00.201 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:06:00.202 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:06:00.203 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:06:00.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:06:00.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:06:00.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:06:00.678 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/32855,v1:127.0.0.1:6819/32855] [v2:127.0.0.1:6820/32855,v1:127.0.0.1:6821/32855] exists,up 09737ee9-281c-40ba-87ee-acc0e2d749dc 2021-03-30T05:06:00.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:06:00.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:06:00.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:06:00.683 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:250: TEST_0_osd: run_osd td/ok-to-stop 3 2021-03-30T05:06:00.683 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ok-to-stop 2021-03-30T05:06:00.683 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:06:00.683 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=3 2021-03-30T05:06:00.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:06:00.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ok-to-stop/3 2021-03-30T05:06:00.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:06:00.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:06:00.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:06:00.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:06:00.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ok-to-stop/3' 2021-03-30T05:06:00.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ok-to-stop/3/journal' 2021-03-30T05:06:00.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:06:00.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:06:00.686 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ok-to-stop' 2021-03-30T05:06:00.686 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:06:00.686 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:06:00.686 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:06:00.686 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:06:00.687 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:00.687 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:00.687 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:00.687 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:00.688 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:06:00.688 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:06:00.688 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:06:00.688 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ok-to-stop/$name.log' 2021-03-30T05:06:00.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ok-to-stop/$name.pid' 2021-03-30T05:06:00.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:06:00.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:06:00.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:06:00.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:06:00.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:06:00.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ok-to-stop/3 2021-03-30T05:06:00.690 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:06:00.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=813bac16-4c51-4d78-a2dc-c834069cb822 2021-03-30T05:06:00.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd3 813bac16-4c51-4d78-a2dc-c834069cb822' 2021-03-30T05:06:00.691 INFO:tasks.workunit.client.0.smithi197.stdout:add osd3 813bac16-4c51-4d78-a2dc-c834069cb822 2021-03-30T05:06:00.691 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:06:00.693 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC4sWJggIlRKRAATSA3Us76B0soxj0AQ6xJng== 2021-03-30T05:06:00.694 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC4sWJggIlRKRAATSA3Us76B0soxj0AQ6xJng=="}' 2021-03-30T05:06:00.694 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 813bac16-4c51-4d78-a2dc-c834069cb822 -i td/ok-to-stop/3/new.json 2021-03-30T05:06:01.196 INFO:tasks.workunit.client.0.smithi197.stdout:3 2021-03-30T05:06:01.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ok-to-stop/3/new.json 2021-03-30T05:06:01.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 3 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/3 --osd-journal=td/ok-to-stop/3/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC4sWJggIlRKRAATSA3Us76B0soxj0AQ6xJng== --osd-uuid 813bac16-4c51-4d78-a2dc-c834069cb822 2021-03-30T05:06:01.227 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.226+0000 7f4d05719f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:06:01.228 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.228+0000 7f4d05719f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:06:01.229 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.228+0000 7f4d05719f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:06:01.230 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.229+0000 7f4d05719f40 -1 bluestore(td/ok-to-stop/3/block) _read_bdev_label failed to open td/ok-to-stop/3/block: (2) No such file or directory 2021-03-30T05:06:01.230 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.229+0000 7f4d05719f40 -1 bluestore(td/ok-to-stop/3/block) _read_bdev_label failed to open td/ok-to-stop/3/block: (2) No such file or directory 2021-03-30T05:06:01.230 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.229+0000 7f4d05719f40 -1 bluestore(td/ok-to-stop/3/block) _read_bdev_label failed to open td/ok-to-stop/3/block: (2) No such file or directory 2021-03-30T05:06:01.286 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.286+0000 7f4d05719f40 -1 bluestore(td/ok-to-stop/3) _read_fsid unparsable uuid 2021-03-30T05:06:01.756 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:01.755+0000 7f4d05719f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:06:04.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ok-to-stop/3/keyring 2021-03-30T05:06:04.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:06:04.565 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd3 key to auth repository 2021-03-30T05:06:04.565 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd3 key to auth repository 2021-03-30T05:06:04.565 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ok-to-stop/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:06:05.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.3 2021-03-30T05:06:05.035 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.3 2021-03-30T05:06:05.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 3 --fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ok-to-stop/3 --osd-journal=td/ok-to-stop/3/journal --chdir= --run-dir=td/ok-to-stop '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ok-to-stop/$name.log' '--pid-file=td/ok-to-stop/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:06:05.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:06:05.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:06:05.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:06:05.053 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:05.052+0000 7f918b043f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:06:05.055 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:05.054+0000 7f918b043f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:06:05.057 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:05.056+0000 7f918b043f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:06:05.385 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 3 2021-03-30T05:06:05.386 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:06:05.386 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=3 2021-03-30T05:06:05.386 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:06:05.386 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:06:05.387 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:06:05.387 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:06:05.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:06:05.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:06:05.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2021-03-30T05:06:05.572 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:05.572+0000 7f918b043f40 -1 Falling back to public interface 2021-03-30T05:06:05.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:06:06.312 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:06:06.311+0000 7f918b043f40 -1 osd.3 0 log_to_monitors {default=true} 2021-03-30T05:06:06.735 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:06:06.735 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:06:06.735 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:06:06.736 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:06:06.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:06:06.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.3 up' 2021-03-30T05:06:07.090 INFO:tasks.workunit.client.0.smithi197.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/33210,v1:127.0.0.1:6827/33210] [v2:127.0.0.1:6828/33210,v1:127.0.0.1:6829/33210] exists,up 813bac16-4c51-4d78-a2dc-c834069cb822 2021-03-30T05:06:07.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:06:07.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:06:07.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:06:07.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:252: TEST_0_osd: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2021-03-30T05:06:07.626 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:253: TEST_0_osd: ceph osd pool create ec erasure ec-profile 2021-03-30T05:06:08.297 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'ec' already exists 2021-03-30T05:06:08.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:255: TEST_0_osd: wait_for_clean 2021-03-30T05:06:08.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:06:08.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:06:08.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:06:08.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:06:08.307 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:06:08.308 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:06:08.308 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:06:08.308 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:06:08.308 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:06:08.308 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:06:08.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:06:08.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:06:08.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:06:08.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:06:08.399 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:06:08.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:06:08.989 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:06:08.989 INFO:tasks.workunit.client.0.smithi197.stderr:2 2021-03-30T05:06:08.990 INFO:tasks.workunit.client.0.smithi197.stderr:3' 2021-03-30T05:06:08.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:06:08.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:08.990 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:06:09.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836488 2021-03-30T05:06:09.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836488 2021-03-30T05:06:09.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836488' 2021-03-30T05:06:09.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:09.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:06:09.238 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=38654705669 2021-03-30T05:06:09.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 38654705669 2021-03-30T05:06:09.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836488 1-38654705669' 2021-03-30T05:06:09.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:09.240 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:06:09.535 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=55834574852 2021-03-30T05:06:09.535 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 55834574852 2021-03-30T05:06:09.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836488 1-38654705669 2-55834574852' 2021-03-30T05:06:09.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:09.537 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2021-03-30T05:06:09.659 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=77309411331 2021-03-30T05:06:09.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 77309411331 2021-03-30T05:06:09.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836488 1-38654705669 2-55834574852 3-77309411331' 2021-03-30T05:06:09.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:09.660 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836488 2021-03-30T05:06:09.661 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:09.662 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:06:09.662 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836488 2021-03-30T05:06:09.662 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:09.662 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836488 2021-03-30T05:06:09.662 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2021-03-30T05:06:09.663 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836488 2021-03-30T05:06:09.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:06:10.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836488 -lt 21474836488 2021-03-30T05:06:10.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:10.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-38654705669 2021-03-30T05:06:10.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:10.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:06:10.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-38654705669 2021-03-30T05:06:10.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:10.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=38654705669 2021-03-30T05:06:10.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2021-03-30T05:06:10.078 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 38654705669 2021-03-30T05:06:10.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:06:10.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 38654705669 -lt 38654705669 2021-03-30T05:06:10.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:10.453 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-55834574852 2021-03-30T05:06:10.453 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:10.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:06:10.454 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-55834574852 2021-03-30T05:06:10.454 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:10.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=55834574852 2021-03-30T05:06:10.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2021-03-30T05:06:10.456 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 55834574852 2021-03-30T05:06:10.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:06:10.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 55834574852 -lt 55834574852 2021-03-30T05:06:10.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:10.802 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-77309411331 2021-03-30T05:06:10.802 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:10.803 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2021-03-30T05:06:10.803 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-77309411331 2021-03-30T05:06:10.804 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:10.804 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=77309411331 2021-03-30T05:06:10.804 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 77309411331' 2021-03-30T05:06:10.805 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.3 seq 77309411331 2021-03-30T05:06:10.805 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2021-03-30T05:06:11.156 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 77309411329 -lt 77309411331 2021-03-30T05:06:11.157 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:06:12.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:06:12.158 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2021-03-30T05:06:12.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 77309411331 -lt 77309411331 2021-03-30T05:06:12.543 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:06:12.543 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:12.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:13.000 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 32 == 0 2021-03-30T05:06:13.001 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:06:13.001 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:06:13.001 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:06:13.002 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:06:13.002 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:06:13.002 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:06:13.002 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:06:13.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=24 2021-03-30T05:06:13.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:06:13.424 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:13.424 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:13.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 24 = 32 2021-03-30T05:06:13.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 24 '!=' -1 2021-03-30T05:06:13.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2021-03-30T05:06:13.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=24 2021-03-30T05:06:13.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:06:13.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2021-03-30T05:06:13.985 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:06:13.985 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:06:13.986 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:06:13.986 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:06:13.986 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:06:13.986 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:06:13.986 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:06:13.987 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:06:14.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=32 2021-03-30T05:06:14.326 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:06:14.326 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:14.327 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:14.786 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 32 = 32 2021-03-30T05:06:14.787 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:06:14.787 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:06:14.787 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:258: TEST_0_osd: ceph osd pool set ec min_size 3 2021-03-30T05:06:15.510 INFO:tasks.workunit.client.0.smithi197.stderr:set pool 1 min_size to 3 2021-03-30T05:06:15.519 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:259: TEST_0_osd: wait_for_clean 2021-03-30T05:06:15.519 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:06:15.519 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:06:15.519 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:06:15.520 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:06:15.520 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:06:15.521 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:06:15.521 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:06:15.521 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:06:15.521 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:06:15.522 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:06:15.608 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:06:15.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:06:15.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:06:15.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:06:15.610 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:06:15.957 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:06:15.958 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:06:15.958 INFO:tasks.workunit.client.0.smithi197.stderr:2 2021-03-30T05:06:15.958 INFO:tasks.workunit.client.0.smithi197.stderr:3' 2021-03-30T05:06:15.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:06:15.959 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:15.959 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:06:16.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836491 2021-03-30T05:06:16.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836491 2021-03-30T05:06:16.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491' 2021-03-30T05:06:16.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:16.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:06:16.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=38654705673 2021-03-30T05:06:16.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 38654705673 2021-03-30T05:06:16.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-38654705673' 2021-03-30T05:06:16.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:16.199 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:06:16.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=55834574856 2021-03-30T05:06:16.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 55834574856 2021-03-30T05:06:16.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-38654705673 2-55834574856' 2021-03-30T05:06:16.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:16.321 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2021-03-30T05:06:16.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=77309411334 2021-03-30T05:06:16.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 77309411334 2021-03-30T05:06:16.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836491 1-38654705673 2-55834574856 3-77309411334' 2021-03-30T05:06:16.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:16.443 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836491 2021-03-30T05:06:16.443 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:16.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:06:16.444 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836491 2021-03-30T05:06:16.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:16.445 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836491 2021-03-30T05:06:16.445 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2021-03-30T05:06:16.446 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836491 2021-03-30T05:06:16.446 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:06:16.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836489 -lt 21474836491 2021-03-30T05:06:16.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:06:17.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:06:17.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:06:18.145 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836491 -lt 21474836491 2021-03-30T05:06:18.145 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:18.145 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-38654705673 2021-03-30T05:06:18.146 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:18.146 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:06:18.147 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-38654705673 2021-03-30T05:06:18.147 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:18.147 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 38654705673 2021-03-30T05:06:18.148 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=38654705673 2021-03-30T05:06:18.148 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2021-03-30T05:06:18.148 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:06:18.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 38654705673 -lt 38654705673 2021-03-30T05:06:18.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:18.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-55834574856 2021-03-30T05:06:18.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:18.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:06:18.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-55834574856 2021-03-30T05:06:18.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:18.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=55834574856 2021-03-30T05:06:18.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 55834574856' 2021-03-30T05:06:18.497 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 55834574856 2021-03-30T05:06:18.497 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:06:18.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 55834574856 -lt 55834574856 2021-03-30T05:06:18.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:18.853 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-77309411334 2021-03-30T05:06:18.853 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:18.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2021-03-30T05:06:18.854 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-77309411334 2021-03-30T05:06:18.854 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:18.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=77309411334 2021-03-30T05:06:18.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 77309411334' 2021-03-30T05:06:18.856 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.3 seq 77309411334 2021-03-30T05:06:18.856 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2021-03-30T05:06:19.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 77309411334 -lt 77309411334 2021-03-30T05:06:19.208 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:06:19.209 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:19.209 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:19.723 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 32 == 0 2021-03-30T05:06:19.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:06:19.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:06:19.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:06:19.725 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:06:19.725 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:06:19.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:06:19.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:06:20.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=32 2021-03-30T05:06:20.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:06:20.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:20.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:20.525 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 32 = 32 2021-03-30T05:06:20.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:06:20.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:06:20.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:261: TEST_0_osd: ceph osd ok-to-stop 0 2021-03-30T05:06:20.880 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 0 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:20.880 INFO:tasks.workunit.client.0.smithi197.stderr:32 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:20.888 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:262: TEST_0_osd: ceph osd ok-to-stop 1 2021-03-30T05:06:21.222 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 1 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:21.222 INFO:tasks.workunit.client.0.smithi197.stderr:32 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:21.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:263: TEST_0_osd: ceph osd ok-to-stop 2 2021-03-30T05:06:21.587 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 2 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:21.587 INFO:tasks.workunit.client.0.smithi197.stderr:32 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:21.595 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:264: TEST_0_osd: ceph osd ok-to-stop 3 2021-03-30T05:06:21.936 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 3 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:21.936 INFO:tasks.workunit.client.0.smithi197.stderr:32 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:21.944 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:265: TEST_0_osd: ceph osd ok-to-stop 0 1 2021-03-30T05:06:22.179 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: 32 PGs are already too degraded, would become too degraded or might become unavailable 2021-03-30T05:06:22.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:266: TEST_0_osd: ceph osd ok-to-stop 2 3 2021-03-30T05:06:22.431 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: 32 PGs are already too degraded, would become too degraded or might become unavailable 2021-03-30T05:06:22.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:269: TEST_0_osd: ceph osd pool set ec min_size 2 2021-03-30T05:06:23.120 INFO:tasks.workunit.client.0.smithi197.stderr:set pool 1 min_size to 2 2021-03-30T05:06:23.128 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:270: TEST_0_osd: wait_for_clean 2021-03-30T05:06:23.128 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:06:23.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:06:23.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:06:23.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:06:23.129 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:06:23.130 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:06:23.131 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:06:23.131 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:06:23.131 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:06:23.132 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:06:23.217 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:06:23.218 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:06:23.218 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:06:23.219 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:06:23.219 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:06:23.764 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:06:23.764 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:06:23.764 INFO:tasks.workunit.client.0.smithi197.stderr:2 2021-03-30T05:06:23.765 INFO:tasks.workunit.client.0.smithi197.stderr:3' 2021-03-30T05:06:23.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:06:23.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:23.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:06:23.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836495 2021-03-30T05:06:23.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836495 2021-03-30T05:06:23.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495' 2021-03-30T05:06:23.974 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:23.974 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:06:24.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=38654705676 2021-03-30T05:06:24.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 38654705676 2021-03-30T05:06:24.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-38654705676' 2021-03-30T05:06:24.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:24.097 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:06:24.219 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=55834574859 2021-03-30T05:06:24.219 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 55834574859 2021-03-30T05:06:24.219 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-38654705676 2-55834574859' 2021-03-30T05:06:24.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:24.220 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2021-03-30T05:06:24.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=77309411338 2021-03-30T05:06:24.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 77309411338 2021-03-30T05:06:24.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836495 1-38654705676 2-55834574859 3-77309411338' 2021-03-30T05:06:24.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:24.375 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836495 2021-03-30T05:06:24.375 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:24.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:06:24.377 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836495 2021-03-30T05:06:24.377 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:24.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836495 2021-03-30T05:06:24.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2021-03-30T05:06:24.378 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836495 2021-03-30T05:06:24.378 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:06:24.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836493 -lt 21474836495 2021-03-30T05:06:24.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:06:25.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:06:25.725 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:06:26.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836495 -lt 21474836495 2021-03-30T05:06:26.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:26.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-38654705676 2021-03-30T05:06:26.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:26.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:06:26.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-38654705676 2021-03-30T05:06:26.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:26.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=38654705676 2021-03-30T05:06:26.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2021-03-30T05:06:26.083 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 38654705676 2021-03-30T05:06:26.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:06:26.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 38654705677 -lt 38654705676 2021-03-30T05:06:26.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:26.432 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-55834574859 2021-03-30T05:06:26.432 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:26.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:06:26.433 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-55834574859 2021-03-30T05:06:26.433 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:26.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=55834574859 2021-03-30T05:06:26.434 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 55834574859 2021-03-30T05:06:26.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 55834574859' 2021-03-30T05:06:26.435 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:06:26.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 55834574859 -lt 55834574859 2021-03-30T05:06:26.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:26.795 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-77309411338 2021-03-30T05:06:26.795 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:26.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2021-03-30T05:06:26.796 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-77309411338 2021-03-30T05:06:26.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:26.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=77309411338 2021-03-30T05:06:26.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 77309411338' 2021-03-30T05:06:26.798 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.3 seq 77309411338 2021-03-30T05:06:26.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2021-03-30T05:06:27.149 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 77309411338 -lt 77309411338 2021-03-30T05:06:27.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:06:27.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:27.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:27.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 32 == 0 2021-03-30T05:06:27.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:06:27.610 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:06:27.610 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:06:27.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:06:27.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:06:27.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:06:27.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:06:27.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=24 2021-03-30T05:06:27.972 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:06:27.972 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:27.972 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:28.522 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 24 = 32 2021-03-30T05:06:28.523 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 24 '!=' -1 2021-03-30T05:06:28.523 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2021-03-30T05:06:28.523 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=24 2021-03-30T05:06:28.524 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:06:28.524 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2021-03-30T05:06:28.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:06:28.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:06:28.623 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:06:28.624 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:06:28.624 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:06:28.624 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:06:28.624 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:06:28.625 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:06:28.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=24 2021-03-30T05:06:28.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:06:28.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:28.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:29.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 24 = 32 2021-03-30T05:06:29.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 24 '!=' 24 2021-03-30T05:06:29.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:06:29.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:06:29.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:06:29.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:06:29.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:06:29.449 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:06:29.449 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:06:29.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:06:29.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:06:29.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 13 )) 2021-03-30T05:06:29.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:06:29.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2021-03-30T05:06:30.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:06:30.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:06:30.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:06:30.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:06:30.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:06:30.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:06:30.171 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:06:30.171 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:06:30.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=32 2021-03-30T05:06:30.534 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:06:30.534 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:30.534 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:30.991 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 32 = 32 2021-03-30T05:06:30.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:06:30.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:06:30.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:272: TEST_0_osd: ceph osd ok-to-stop 0 1 2021-03-30T05:06:31.327 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 0,1 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:31.328 INFO:tasks.workunit.client.0.smithi197.stderr:32 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:31.335 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:273: TEST_0_osd: ceph osd ok-to-stop 2 3 2021-03-30T05:06:31.673 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 2,3 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:31.674 INFO:tasks.workunit.client.0.smithi197.stderr:32 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:31.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:274: TEST_0_osd: ceph osd ok-to-stop 0 1 2 2021-03-30T05:06:31.921 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: 32 PGs are already too degraded, would become too degraded or might become unavailable 2021-03-30T05:06:31.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:275: TEST_0_osd: ceph osd ok-to-stop 1 2 3 2021-03-30T05:06:32.162 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: 32 PGs are already too degraded, would become too degraded or might become unavailable 2021-03-30T05:06:32.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:278: TEST_0_osd: kill_daemons td/ok-to-stop TERM osd.0 2021-03-30T05:06:32.164 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:32.164 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:32.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:32.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:32.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:32.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:32.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:279: TEST_0_osd: ceph osd down 0 2021-03-30T05:06:33.013 INFO:tasks.workunit.client.0.smithi197.stderr:osd.0 is already down. 2021-03-30T05:06:33.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:280: TEST_0_osd: wait_for_peered 2021-03-30T05:06:33.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_peered: local cmd= 2021-03-30T05:06:33.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1638: wait_for_peered: local num_peered=-1 2021-03-30T05:06:33.023 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_peered: local cur_peered 2021-03-30T05:06:33.023 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_peered: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:06:33.023 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_peered: get_timeout_delays 90 .1 2021-03-30T05:06:33.023 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:06:33.024 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:06:33.024 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:06:33.024 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:06:33.024 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:06:33.109 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_peered: local -a delays 2021-03-30T05:06:33.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1641: wait_for_peered: local -i loop=0 2021-03-30T05:06:33.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1643: wait_for_peered: flush_pg_stats 2021-03-30T05:06:33.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:06:33.110 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:06:33.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:06:33.471 INFO:tasks.workunit.client.0.smithi197.stderr:1 2021-03-30T05:06:33.471 INFO:tasks.workunit.client.0.smithi197.stderr:2 2021-03-30T05:06:33.471 INFO:tasks.workunit.client.0.smithi197.stderr:3' 2021-03-30T05:06:33.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:06:33.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:33.472 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:06:33.553 INFO:tasks.workunit.client.0.smithi197.stderr:Error ENXIO: problem getting command descriptions from osd.0 2021-03-30T05:06:33.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq= 2021-03-30T05:06:33.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z '' 2021-03-30T05:06:33.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2075: flush_pg_stats: continue 2021-03-30T05:06:33.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:33.556 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:06:33.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=38654705680 2021-03-30T05:06:33.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 38654705680 2021-03-30T05:06:33.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-38654705680' 2021-03-30T05:06:33.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:33.715 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2021-03-30T05:06:33.847 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=55834574863 2021-03-30T05:06:33.847 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 55834574863 2021-03-30T05:06:33.847 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-38654705680 2-55834574863' 2021-03-30T05:06:33.847 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:06:33.848 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2021-03-30T05:06:33.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=77309411342 2021-03-30T05:06:33.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 77309411342 2021-03-30T05:06:33.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 1-38654705680 2-55834574863 3-77309411342' 2021-03-30T05:06:33.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:33.969 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-38654705680 2021-03-30T05:06:33.970 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:33.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:06:33.971 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-38654705680 2021-03-30T05:06:33.971 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:33.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=38654705680 2021-03-30T05:06:33.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2021-03-30T05:06:33.972 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 38654705680 2021-03-30T05:06:33.972 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:06:34.322 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 38654705678 -lt 38654705680 2021-03-30T05:06:34.322 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:06:35.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:06:35.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:06:35.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 38654705678 -lt 38654705680 2021-03-30T05:06:35.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:06:36.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:06:36.680 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:06:37.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 38654705681 -lt 38654705680 2021-03-30T05:06:37.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:37.038 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 2-55834574863 2021-03-30T05:06:37.038 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:37.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=2 2021-03-30T05:06:37.039 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 2-55834574863 2021-03-30T05:06:37.039 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:37.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=55834574863 2021-03-30T05:06:37.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.2 seq 55834574863' 2021-03-30T05:06:37.040 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.2 seq 55834574863 2021-03-30T05:06:37.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 2 2021-03-30T05:06:37.387 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 55834574863 -lt 55834574863 2021-03-30T05:06:37.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:06:37.388 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 3-77309411342 2021-03-30T05:06:37.388 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:06:37.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=3 2021-03-30T05:06:37.389 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 3-77309411342 2021-03-30T05:06:37.389 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:06:37.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=77309411342 2021-03-30T05:06:37.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.3 seq 77309411342' 2021-03-30T05:06:37.391 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.3 seq 77309411342 2021-03-30T05:06:37.391 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 3 2021-03-30T05:06:37.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 77309411342 -lt 77309411342 2021-03-30T05:06:37.739 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_peered: get_num_pgs 2021-03-30T05:06:37.740 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:37.740 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:38.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_peered: test 32 == 0 2021-03-30T05:06:38.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_peered: true 2021-03-30T05:06:38.199 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_peered: get_num_active_or_peered 2021-03-30T05:06:38.199 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1332: get_num_active_or_peered: local expression 2021-03-30T05:06:38.199 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1333: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2021-03-30T05:06:38.200 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2021-03-30T05:06:38.200 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_num_active_or_peered: ceph --format json pg dump pgs 2021-03-30T05:06:38.200 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2021-03-30T05:06:38.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_peered: cur_peered=32 2021-03-30T05:06:38.540 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_peered: get_num_pgs 2021-03-30T05:06:38.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:06:38.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:06:39.000 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_peered: test 32 = 32 2021-03-30T05:06:39.001 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_peered: break 2021-03-30T05:06:39.001 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1668: wait_for_peered: return 0 2021-03-30T05:06:39.001 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:282: TEST_0_osd: ceph osd ok-to-stop 0 2021-03-30T05:06:39.343 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 0 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:39.344 INFO:tasks.workunit.client.0.smithi197.stderr:0 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:39.352 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:283: TEST_0_osd: ceph osd ok-to-stop 0 1 2021-03-30T05:06:39.689 INFO:tasks.workunit.client.0.smithi197.stderr:OSD(s) 0,1 are ok to stop without reducing availability or risking data, provided there are no other concurrent failures or interventions. 2021-03-30T05:06:39.689 INFO:tasks.workunit.client.0.smithi197.stderr:32 PGs are likely to be degraded (but remain available) as a result. 2021-03-30T05:06:39.696 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:284: TEST_0_osd: ceph osd ok-to-stop 0 1 2 2021-03-30T05:06:39.935 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: 32 PGs are already too degraded, would become too degraded or might become unavailable 2021-03-30T05:06:39.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:285: TEST_0_osd: ceph osd ok-to-stop 1 2 3 2021-03-30T05:06:40.173 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: 32 PGs are already too degraded, would become too degraded or might become unavailable 2021-03-30T05:06:40.175 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:40.175 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:40.175 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:40.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:40.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:40.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:40.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:40.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2021-03-30T05:06:40.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:06:40.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:06:40.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:40.285 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:40.285 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:40.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:40.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:40.286 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:40.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:40.289 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:06:40.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:06:40.290 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:06:40.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:06:40.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:06:40.291 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:06:40.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:40.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:06:40.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:06:40.294 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:40.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:06:40.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:06:40.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:06:40.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:06:40.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:40.305 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:40.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:06:40.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:06:40.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:06:40.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2021-03-30T05:06:40.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2021-03-30T05:06:40.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2021-03-30T05:06:40.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2021-03-30T05:06:40.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:06:40.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:06:40.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:40.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:40.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:40.309 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:40.309 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:40.310 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:40.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:40.311 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:06:40.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:06:40.312 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:06:40.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:06:40.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:06:40.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:06:40.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:40.314 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:06:40.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:06:40.320 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:40.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:06:40.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:06:40.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:06:40.321 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:06:40.322 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:40.322 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:40.322 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:06:40.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:06:40.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:06:40.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2021-03-30T05:06:40.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:06:40.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:40.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:40.324 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30648 2021-03-30T05:06:40.325 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:06:40.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:06:40.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:06:40.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2021-03-30T05:06:40.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_1_mon_checks td/ok-to-stop 2021-03-30T05:06:40.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:28: TEST_1_mon_checks: local dir=td/ok-to-stop 2021-03-30T05:06:40.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:30: TEST_1_mon_checks: CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150 ' 2021-03-30T05:06:40.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:32: TEST_1_mon_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2021-03-30T05:06:40.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:06:40.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:06:40.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:06:40.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:06:40.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2021-03-30T05:06:40.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2021-03-30T05:06:40.624 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:06:40.625 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:06:40.625 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:06:40.625 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:06:40.625 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:40.625 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:40.626 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:40.626 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2021-03-30T05:06:40.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:06:40.777 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:06:40.777 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:40.777 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:06:40.777 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:06:40.778 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:06:40.778 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:06:40.778 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:06:40.778 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:06:40.779 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:40.779 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:40.779 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:40.779 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:06:40.779 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:40.780 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get fsid 2021-03-30T05:06:40.864 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:06:40.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:40.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:06:40.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:06:40.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:06:40.865 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:06:40.866 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:06:40.866 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:06:40.866 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:40.866 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:40.866 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:40.867 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:06:40.867 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:40.867 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get mon_host 2021-03-30T05:06:40.950 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:34: TEST_1_mon_checks: ceph mon ok-to-stop dne 2021-03-30T05:06:41.361 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a) after stopping [dne] 2021-03-30T05:06:41.369 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:35: TEST_1_mon_checks: ceph mon ok-to-stop a 2021-03-30T05:06:41.524 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available () after stopping mons [a] 2021-03-30T05:06:41.525 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:37: TEST_1_mon_checks: ceph mon ok-to-add-offline 2021-03-30T05:06:41.681 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2021-03-30T05:06:41.683 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:39: TEST_1_mon_checks: ceph mon ok-to-rm a 2021-03-30T05:06:41.838 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: removing mon.a would break quorum 2021-03-30T05:06:41.839 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:40: TEST_1_mon_checks: ceph mon ok-to-rm dne 2021-03-30T05:06:42.045 INFO:tasks.workunit.client.0.smithi197.stderr:mon.dne does not exist 2021-03-30T05:06:42.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:42.053 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:42.054 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:42.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:42.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:42.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:42.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:42.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2021-03-30T05:06:42.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:06:42.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:06:42.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:42.160 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:42.160 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:42.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:42.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:42.161 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:42.162 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:42.162 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:06:42.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:06:42.163 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:06:42.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:06:42.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:06:42.164 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:06:42.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:42.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:06:42.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:06:42.167 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:42.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:06:42.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:06:42.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:06:42.169 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:06:42.169 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:42.169 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:42.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:06:42.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:06:42.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:06:42.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2021-03-30T05:06:42.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2021-03-30T05:06:42.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2021-03-30T05:06:42.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2021-03-30T05:06:42.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:06:42.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:06:42.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:42.173 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:42.173 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:42.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:42.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:42.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:42.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:42.176 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:06:42.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:06:42.176 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:06:42.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:06:42.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:06:42.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:06:42.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:42.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:06:42.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:06:42.178 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:42.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:06:42.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:06:42.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:06:42.180 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:06:42.180 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:42.181 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:42.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:06:42.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:06:42.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:06:42.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2021-03-30T05:06:42.183 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:06:42.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:42.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:42.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30648 2021-03-30T05:06:42.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:06:42.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:06:42.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:06:42.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2021-03-30T05:06:42.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_2_mons_checks td/ok-to-stop 2021-03-30T05:06:42.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:44: TEST_2_mons_checks: local dir=td/ok-to-stop 2021-03-30T05:06:42.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:46: TEST_2_mons_checks: CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151 ' 2021-03-30T05:06:42.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:48: TEST_2_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2021-03-30T05:06:42.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:06:42.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:06:42.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:06:42.187 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:06:42.187 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2021-03-30T05:06:42.187 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2021-03-30T05:06:42.464 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:06:42.464 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:06:42.465 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:06:42.465 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:06:42.465 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:42.465 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:42.465 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:42.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2021-03-30T05:06:42.614 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:06:42.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:06:42.617 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:42.617 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:06:42.617 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:06:42.617 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:06:42.618 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:06:42.618 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:06:42.618 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:06:42.618 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:42.618 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:42.619 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:42.619 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:06:42.619 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:42.619 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get fsid 2021-03-30T05:06:42.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:06:42.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:42.705 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:06:42.705 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:06:42.705 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:06:42.705 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:06:42.705 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:06:42.706 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:06:42.706 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:42.706 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:42.706 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:42.707 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:06:42.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:42.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get mon_host 2021-03-30T05:06:42.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:49: TEST_2_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2021-03-30T05:06:42.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:06:42.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:06:42.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2021-03-30T05:06:42.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:06:42.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2021-03-30T05:06:42.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2021-03-30T05:06:43.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:06:43.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:06:43.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:06:43.059 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:06:43.059 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:43.059 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:43.060 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:43.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2021-03-30T05:06:43.226 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:06:43.228 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b fsid 2021-03-30T05:06:43.228 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:43.229 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:06:43.229 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:06:43.229 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:06:43.229 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:06:43.230 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:06:43.230 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:06:43.230 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:43.230 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:43.230 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:43.231 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:06:43.231 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:43.231 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get fsid 2021-03-30T05:06:43.315 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b mon_host 2021-03-30T05:06:43.316 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:43.316 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:06:43.316 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:06:43.317 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:06:43.317 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:06:43.317 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:06:43.317 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:06:43.317 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:43.318 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:43.318 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:43.318 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:06:43.318 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:43.318 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get mon_host 2021-03-30T05:06:43.401 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:51: TEST_2_mons_checks: ceph mon ok-to-stop dne 2021-03-30T05:06:46.661 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b) after stopping [dne] 2021-03-30T05:06:46.669 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:52: TEST_2_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:06:46.844 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (b) after stopping mons [a] 2021-03-30T05:06:46.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:53: TEST_2_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:06:47.044 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons [b] 2021-03-30T05:06:47.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:54: TEST_2_mons_checks: ceph mon ok-to-stop a b 2021-03-30T05:06:47.204 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available () after stopping mons [a,b] 2021-03-30T05:06:47.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:56: TEST_2_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:06:47.410 INFO:tasks.workunit.client.0.smithi197.stderr:adding another mon that is not yet online will not break quorum 2021-03-30T05:06:47.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:58: TEST_2_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:06:47.626 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.a 2021-03-30T05:06:47.634 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:59: TEST_2_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:06:47.899 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.b 2021-03-30T05:06:47.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:60: TEST_2_mons_checks: ceph mon ok-to-rm dne 2021-03-30T05:06:48.165 INFO:tasks.workunit.client.0.smithi197.stderr:mon.dne does not exist 2021-03-30T05:06:48.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:48.174 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:48.174 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:48.175 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:48.175 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:48.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:48.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:48.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2021-03-30T05:06:48.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:06:48.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:06:48.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:48.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:48.283 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:48.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:48.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:48.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:48.287 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:48.288 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:06:48.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:06:48.288 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:06:48.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:06:48.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:06:48.290 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:06:48.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:48.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:06:48.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:06:48.291 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:48.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:06:48.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:06:48.303 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:06:48.303 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:06:48.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:48.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:48.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:06:48.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:06:48.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:06:48.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2021-03-30T05:06:48.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2021-03-30T05:06:48.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2021-03-30T05:06:48.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2021-03-30T05:06:48.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:06:48.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:06:48.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:06:48.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:48.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:48.310 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:48.310 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:48.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:48.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:48.312 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:06:48.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:06:48.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:06:48.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:06:48.314 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:06:48.314 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:06:48.315 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:48.315 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:06:48.315 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:06:48.316 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:06:48.316 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:06:48.317 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:06:48.317 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:06:48.318 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:06:48.318 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:48.318 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:48.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:06:48.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:06:48.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:06:48.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2021-03-30T05:06:48.321 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:06:48.321 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:48.321 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:48.322 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30648 2021-03-30T05:06:48.326 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:06:48.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:06:48.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:06:48.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2021-03-30T05:06:48.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_3_mons_checks td/ok-to-stop 2021-03-30T05:06:48.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:64: TEST_3_mons_checks: local dir=td/ok-to-stop 2021-03-30T05:06:48.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:66: TEST_3_mons_checks: CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152 ' 2021-03-30T05:06:48.329 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:68: TEST_3_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2021-03-30T05:06:48.329 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:06:48.330 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:06:48.330 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:06:48.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:06:48.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2021-03-30T05:06:48.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2021-03-30T05:06:48.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:06:48.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:06:48.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:06:48.638 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:06:48.639 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:48.639 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:48.640 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:48.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2021-03-30T05:06:48.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:06:48.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:06:48.833 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:48.833 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:06:48.834 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:06:48.834 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:06:48.834 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:06:48.835 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:06:48.835 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:06:48.836 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:48.836 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:48.837 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:48.837 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:06:48.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:48.838 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get fsid 2021-03-30T05:06:48.919 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:06:48.920 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:48.920 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:06:48.921 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:06:48.921 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:06:48.922 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:06:48.922 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:06:48.922 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:06:48.923 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:48.923 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:48.924 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:48.924 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:06:48.925 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:48.925 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get mon_host 2021-03-30T05:06:49.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:69: TEST_3_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2021-03-30T05:06:49.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:06:49.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:06:49.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2021-03-30T05:06:49.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:06:49.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2021-03-30T05:06:49.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2021-03-30T05:06:49.323 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:06:49.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:06:49.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:06:49.325 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:06:49.325 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:49.326 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:49.326 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:49.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2021-03-30T05:06:49.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:06:49.492 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b fsid 2021-03-30T05:06:49.492 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:49.492 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:06:49.492 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:06:49.493 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:06:49.493 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:06:49.493 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:06:49.493 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:06:49.493 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:49.494 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:49.494 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:49.494 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:06:49.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:49.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get fsid 2021-03-30T05:06:49.578 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b mon_host 2021-03-30T05:06:49.579 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:49.579 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:06:49.579 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:06:49.580 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:06:49.580 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:06:49.580 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:06:49.580 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:06:49.580 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:49.581 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:49.581 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:49.581 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:06:49.581 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:49.582 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get mon_host 2021-03-30T05:06:49.665 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:70: TEST_3_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2021-03-30T05:06:49.665 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:06:49.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:06:49.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=c 2021-03-30T05:06:49.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:06:49.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/c 2021-03-30T05:06:49.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2021-03-30T05:06:49.934 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:06:49.934 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:06:49.935 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:06:49.935 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:06:49.935 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:49.935 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:49.936 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:06:49.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2021-03-30T05:06:50.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:06:50.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon c fsid 2021-03-30T05:06:50.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:50.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=c 2021-03-30T05:06:50.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:06:50.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:06:50.105 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.c 2021-03-30T05:06:50.105 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2021-03-30T05:06:50.105 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2021-03-30T05:06:50.105 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:50.106 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:50.106 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:50.106 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.c.asok 2021-03-30T05:06:50.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:50.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.c.asok config get fsid 2021-03-30T05:06:50.192 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon c mon_host 2021-03-30T05:06:50.192 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:06:50.192 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=c 2021-03-30T05:06:50.193 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:06:50.193 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:06:50.193 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.c 2021-03-30T05:06:50.193 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2021-03-30T05:06:50.193 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2021-03-30T05:06:50.194 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:06:50.194 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:06:50.194 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:06:50.194 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.c.asok 2021-03-30T05:06:50.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:06:50.195 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.c.asok config get mon_host 2021-03-30T05:06:50.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:71: TEST_3_mons_checks: wait_for_quorum 60 3 2021-03-30T05:06:50.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: wait_for_quorum: local timeout=60 2021-03-30T05:06:50.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: wait_for_quorum: local quorumsize=3 2021-03-30T05:06:50.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: wait_for_quorum: [[ -z 60 ]] 2021-03-30T05:06:50.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: wait_for_quorum: [[ -z 3 ]] 2021-03-30T05:06:50.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: wait_for_quorum: no_quorum=1 2021-03-30T05:06:50.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: date +%s 2021-03-30T05:06:50.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: wait_until=1617080870 2021-03-30T05:06:50.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:50.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080810 -lt 1617080870 ]] 2021-03-30T05:06:50.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:06:50.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:06:51.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:06:51.938 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:51.939 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:06:51.939 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:51.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=true 2021-03-30T05:06:51.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ true == \t\r\u\e ]] 2021-03-30T05:06:51.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: wait_for_quorum: no_quorum=0 2021-03-30T05:06:51.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: wait_for_quorum: break 2021-03-30T05:06:51.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: wait_for_quorum: return 0 2021-03-30T05:06:51.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:73: TEST_3_mons_checks: ceph mon ok-to-stop dne 2021-03-30T05:06:52.154 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,c) after stopping [dne] 2021-03-30T05:06:52.162 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:74: TEST_3_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:06:52.406 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c) after stopping [a] 2021-03-30T05:06:52.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:75: TEST_3_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:06:52.636 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,c) after stopping [b] 2021-03-30T05:06:52.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:76: TEST_3_mons_checks: ceph mon ok-to-stop c 2021-03-30T05:06:52.850 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b) after stopping [c] 2021-03-30T05:06:52.858 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:77: TEST_3_mons_checks: ceph mon ok-to-stop a b 2021-03-30T05:06:53.017 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (c) after stopping mons [a,b] 2021-03-30T05:06:53.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:78: TEST_3_mons_checks: ceph mon ok-to-stop b c 2021-03-30T05:06:53.199 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons [b,c] 2021-03-30T05:06:53.200 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:79: TEST_3_mons_checks: ceph mon ok-to-stop a b c 2021-03-30T05:06:53.398 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available () after stopping mons [a,b,c] 2021-03-30T05:06:53.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:81: TEST_3_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:06:53.636 INFO:tasks.workunit.client.0.smithi197.stderr:adding another mon that is not yet online will not break quorum 2021-03-30T05:06:53.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:83: TEST_3_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:06:53.853 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.a 2021-03-30T05:06:53.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:84: TEST_3_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:06:54.094 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.b 2021-03-30T05:06:54.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:85: TEST_3_mons_checks: ceph mon ok-to-rm c 2021-03-30T05:06:54.311 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.c 2021-03-30T05:06:54.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:87: TEST_3_mons_checks: kill_daemons td/ok-to-stop KILL mon.b 2021-03-30T05:06:54.320 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:06:54.320 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:06:54.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:06:54.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:06:54.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:06:54.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:06:54.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:88: TEST_3_mons_checks: wait_for_quorum 60 2 2021-03-30T05:06:54.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: wait_for_quorum: local timeout=60 2021-03-30T05:06:54.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: wait_for_quorum: local quorumsize=2 2021-03-30T05:06:54.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: wait_for_quorum: [[ -z 60 ]] 2021-03-30T05:06:54.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: wait_for_quorum: [[ -z 2 ]] 2021-03-30T05:06:54.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: wait_for_quorum: no_quorum=1 2021-03-30T05:06:54.427 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: date +%s 2021-03-30T05:06:54.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: wait_until=1617080874 2021-03-30T05:06:54.428 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:54.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080814 -lt 1617080874 ]] 2021-03-30T05:06:54.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:06:54.429 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:06:54.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:06:54.641 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:54.641 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:06:54.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:54.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:06:54.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:06:54.644 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:54.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080814 -lt 1617080874 ]] 2021-03-30T05:06:54.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:06:54.645 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:06:54.857 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:06:54.858 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:54.858 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:06:54.859 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:54.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:06:54.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:06:54.861 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:54.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080814 -lt 1617080874 ]] 2021-03-30T05:06:54.862 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:06:54.862 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:06:58.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:06:58.081 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:06:58.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:06:58.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:06:58.084 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:58.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080818 -lt 1617080874 ]] 2021-03-30T05:06:58.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:06:58.085 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:06:58.297 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:06:58.298 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.298 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:06:58.298 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:06:58.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:06:58.301 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:58.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080818 -lt 1617080874 ]] 2021-03-30T05:06:58.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:06:58.302 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:06:58.515 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:06:58.515 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.516 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:06:58.516 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.518 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:06:58.518 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:06:58.518 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:58.519 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080818 -lt 1617080874 ]] 2021-03-30T05:06:58.519 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:06:58.519 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:06:58.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:06:58.732 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.733 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:06:58.733 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:06:58.735 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:06:58.735 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:06:58.735 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:06:58.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080818 -lt 1617080874 ]] 2021-03-30T05:06:58.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:06:58.737 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:01.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:01.958 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:01.959 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:07:01.960 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:01.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:01.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:01.963 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:01.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080821 -lt 1617080874 ]] 2021-03-30T05:07:01.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:07:01.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:02.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:02.176 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:02.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:07:02.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:02.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:02.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:02.179 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:02.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080822 -lt 1617080874 ]] 2021-03-30T05:07:02.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 2' 2021-03-30T05:07:02.181 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:09.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:09.827 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:09.828 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 2' 2021-03-30T05:07:09.828 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":8,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:06:48.319759Z","created":"2021-03-30T05:06:48.319759Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:09.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=true 2021-03-30T05:07:09.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ true == \t\r\u\e ]] 2021-03-30T05:07:09.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: wait_for_quorum: no_quorum=0 2021-03-30T05:07:09.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: wait_for_quorum: break 2021-03-30T05:07:09.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: wait_for_quorum: return 0 2021-03-30T05:07:09.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:90: TEST_3_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:07:12.993 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (c) after stopping mons [a] 2021-03-30T05:07:12.994 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:91: TEST_3_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:07:13.204 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,c) after stopping [b] 2021-03-30T05:07:13.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:92: TEST_3_mons_checks: ceph mon ok-to-stop c 2021-03-30T05:07:13.370 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (a) after stopping mons [c] 2021-03-30T05:07:13.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:94: TEST_3_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:07:13.538 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2021-03-30T05:07:13.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:96: TEST_3_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:07:13.713 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: removing mon.a would break quorum 2021-03-30T05:07:13.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:97: TEST_3_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:07:13.955 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.b 2021-03-30T05:07:13.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:98: TEST_3_mons_checks: ceph mon ok-to-rm c 2021-03-30T05:07:14.154 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: removing mon.c would break quorum 2021-03-30T05:07:14.156 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2021-03-30T05:07:14.157 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:14.157 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:14.157 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:14.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:14.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:14.262 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:14.263 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2021-03-30T05:07:14.263 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:07:14.263 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:07:14.263 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:07:14.264 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:14.264 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:14.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:14.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:14.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:14.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:14.267 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:07:14.267 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:07:14.268 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:07:14.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:07:14.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:07:14.269 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:07:14.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:14.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:07:14.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:07:14.271 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:14.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:07:14.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:07:14.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:07:14.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:07:14.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:14.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:14.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:07:14.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:07:14.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:07:14.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2021-03-30T05:07:14.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2021-03-30T05:07:14.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2021-03-30T05:07:14.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2021-03-30T05:07:14.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:07:14.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:07:14.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:07:14.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:14.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:14.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:14.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:14.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:14.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:14.283 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:07:14.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:07:14.283 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:07:14.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:07:14.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:07:14.284 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:07:14.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:14.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:07:14.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:07:14.285 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:14.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:07:14.286 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:07:14.287 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:07:14.287 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:07:14.287 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:14.288 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:14.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:07:14.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:07:14.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:07:14.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2021-03-30T05:07:14.291 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:07:14.291 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:14.291 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:14.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30648 2021-03-30T05:07:14.292 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:07:14.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:07:14.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:07:14.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2021-03-30T05:07:14.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_4_mons_checks td/ok-to-stop 2021-03-30T05:07:14.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:102: TEST_4_mons_checks: local dir=td/ok-to-stop 2021-03-30T05:07:14.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:104: TEST_4_mons_checks: CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152,127.0.0.1:7153 ' 2021-03-30T05:07:14.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:106: TEST_4_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2021-03-30T05:07:14.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:14.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:14.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:07:14.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:14.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2021-03-30T05:07:14.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2021-03-30T05:07:14.619 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:14.619 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:14.619 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:14.620 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:14.620 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:14.620 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:14.620 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:14.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2021-03-30T05:07:14.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:14.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:07:14.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:14.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:07:14.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:14.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:14.798 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:07:14.798 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:07:14.798 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:07:14.798 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:14.799 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:14.799 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:14.799 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:07:14.799 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:14.799 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get fsid 2021-03-30T05:07:14.883 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:07:14.884 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:14.884 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:07:14.884 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:14.884 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:14.885 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:07:14.885 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:07:14.885 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:07:14.885 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:14.885 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:14.886 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:14.886 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:07:14.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:14.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get mon_host 2021-03-30T05:07:14.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:107: TEST_4_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2021-03-30T05:07:14.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:14.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:14.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2021-03-30T05:07:14.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:14.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2021-03-30T05:07:14.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2021-03-30T05:07:15.264 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:15.264 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:15.264 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:15.264 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:15.265 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:15.265 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:15.265 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:15.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2021-03-30T05:07:15.406 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:15.408 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b fsid 2021-03-30T05:07:15.408 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:15.408 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:07:15.408 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:15.409 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:15.409 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:07:15.409 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:07:15.409 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:07:15.409 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:15.410 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:15.410 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:15.410 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:07:15.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:15.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get fsid 2021-03-30T05:07:15.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b mon_host 2021-03-30T05:07:15.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:15.495 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:07:15.496 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:15.496 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:15.496 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:07:15.496 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:07:15.496 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:07:15.497 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:15.497 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:15.497 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:15.497 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:07:15.497 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:15.498 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get mon_host 2021-03-30T05:07:15.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:108: TEST_4_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2021-03-30T05:07:15.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:15.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:15.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=c 2021-03-30T05:07:15.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:15.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/c 2021-03-30T05:07:15.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2021-03-30T05:07:15.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:15.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:15.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:15.794 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:15.795 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:15.795 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:15.795 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:15.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2021-03-30T05:07:15.976 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:15.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon c fsid 2021-03-30T05:07:15.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:15.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=c 2021-03-30T05:07:15.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:15.979 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:15.979 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.c 2021-03-30T05:07:15.979 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2021-03-30T05:07:15.979 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2021-03-30T05:07:15.980 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:15.980 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:15.980 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:15.980 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.c.asok 2021-03-30T05:07:15.980 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:15.981 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.c.asok config get fsid 2021-03-30T05:07:16.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon c mon_host 2021-03-30T05:07:16.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:16.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=c 2021-03-30T05:07:16.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:16.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:16.066 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.c 2021-03-30T05:07:16.066 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2021-03-30T05:07:16.067 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2021-03-30T05:07:16.067 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:16.067 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:16.067 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:16.068 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.c.asok 2021-03-30T05:07:16.068 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:16.068 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.c.asok config get mon_host 2021-03-30T05:07:16.151 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:109: TEST_4_mons_checks: run_mon td/ok-to-stop d --public-addr=127.0.0.1:7153 2021-03-30T05:07:16.151 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:16.151 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:16.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=d 2021-03-30T05:07:16.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:16.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/d 2021-03-30T05:07:16.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id d --mkfs --mon-data=td/ok-to-stop/d --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7153 2021-03-30T05:07:16.487 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:16.487 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:16.487 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:16.487 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:16.488 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:16.488 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:16.488 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:16.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id d --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/d '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7153 2021-03-30T05:07:16.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:16.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon d fsid 2021-03-30T05:07:16.639 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:16.639 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=d 2021-03-30T05:07:16.639 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:16.639 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:16.640 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.d 2021-03-30T05:07:16.640 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2021-03-30T05:07:16.640 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2021-03-30T05:07:16.640 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:16.641 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:16.641 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:16.641 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.d.asok 2021-03-30T05:07:16.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:16.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.d.asok config get fsid 2021-03-30T05:07:16.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon d mon_host 2021-03-30T05:07:16.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:16.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=d 2021-03-30T05:07:16.727 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:16.727 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:16.727 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.d 2021-03-30T05:07:16.727 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2021-03-30T05:07:16.728 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2021-03-30T05:07:16.728 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:16.728 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:16.728 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:16.728 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.d.asok 2021-03-30T05:07:16.729 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:16.729 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.d.asok config get mon_host 2021-03-30T05:07:16.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:110: TEST_4_mons_checks: wait_for_quorum 60 4 2021-03-30T05:07:16.813 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: wait_for_quorum: local timeout=60 2021-03-30T05:07:16.813 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: wait_for_quorum: local quorumsize=4 2021-03-30T05:07:16.813 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: wait_for_quorum: [[ -z 60 ]] 2021-03-30T05:07:16.813 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: wait_for_quorum: [[ -z 4 ]] 2021-03-30T05:07:16.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: wait_for_quorum: no_quorum=1 2021-03-30T05:07:16.814 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: date +%s 2021-03-30T05:07:16.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: wait_until=1617080896 2021-03-30T05:07:16.815 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:16.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080836 -lt 1617080896 ]] 2021-03-30T05:07:16.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:07:16.816 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:20.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:20.057 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:20.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:07:20.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:20.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=true 2021-03-30T05:07:20.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ true == \t\r\u\e ]] 2021-03-30T05:07:20.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: wait_for_quorum: no_quorum=0 2021-03-30T05:07:20.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: wait_for_quorum: break 2021-03-30T05:07:20.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: wait_for_quorum: return 0 2021-03-30T05:07:20.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:112: TEST_4_mons_checks: ceph mon ok-to-stop dne 2021-03-30T05:07:20.302 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,c,d) after stopping [dne] 2021-03-30T05:07:20.310 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:113: TEST_4_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:07:20.519 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,d) after stopping [a] 2021-03-30T05:07:20.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:114: TEST_4_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:07:20.770 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,c,d) after stopping [b] 2021-03-30T05:07:20.778 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:115: TEST_4_mons_checks: ceph mon ok-to-stop c 2021-03-30T05:07:21.012 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,d) after stopping [c] 2021-03-30T05:07:21.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:116: TEST_4_mons_checks: ceph mon ok-to-stop d 2021-03-30T05:07:21.245 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,c) after stopping [d] 2021-03-30T05:07:21.253 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:117: TEST_4_mons_checks: ceph mon ok-to-stop a b 2021-03-30T05:07:21.411 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons [a,b] 2021-03-30T05:07:21.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:118: TEST_4_mons_checks: ceph mon ok-to-stop c d 2021-03-30T05:07:21.596 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (a,b) after stopping mons [c,d] 2021-03-30T05:07:21.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:120: TEST_4_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:07:21.814 INFO:tasks.workunit.client.0.smithi197.stderr:adding another mon that is not yet online will not break quorum 2021-03-30T05:07:21.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:122: TEST_4_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:07:22.038 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.a 2021-03-30T05:07:22.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:123: TEST_4_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:07:22.349 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.b 2021-03-30T05:07:22.357 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:124: TEST_4_mons_checks: ceph mon ok-to-rm c 2021-03-30T05:07:22.628 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.c 2021-03-30T05:07:22.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:126: TEST_4_mons_checks: kill_daemons td/ok-to-stop KILL mon.a 2021-03-30T05:07:22.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:22.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:22.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:22.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:22.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:22.743 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:22.743 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:127: TEST_4_mons_checks: wait_for_quorum 60 3 2021-03-30T05:07:22.743 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: wait_for_quorum: local timeout=60 2021-03-30T05:07:22.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: wait_for_quorum: local quorumsize=3 2021-03-30T05:07:22.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: wait_for_quorum: [[ -z 60 ]] 2021-03-30T05:07:22.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: wait_for_quorum: [[ -z 3 ]] 2021-03-30T05:07:22.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: wait_for_quorum: no_quorum=1 2021-03-30T05:07:22.745 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: date +%s 2021-03-30T05:07:22.745 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: wait_until=1617080902 2021-03-30T05:07:22.746 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:22.746 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080842 -lt 1617080902 ]] 2021-03-30T05:07:22.746 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:22.746 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:22.957 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:22.958 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:22.958 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:22.959 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:22.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:22.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:22.961 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:22.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080842 -lt 1617080902 ]] 2021-03-30T05:07:22.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:22.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:23.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:23.174 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.174 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:23.175 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:23.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:23.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:23.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080843 -lt 1617080902 ]] 2021-03-30T05:07:23.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:23.178 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:23.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:23.391 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.392 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:23.392 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:23.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:23.395 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:23.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080843 -lt 1617080902 ]] 2021-03-30T05:07:23.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:23.396 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:23.607 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:23.607 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.608 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:23.608 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:23.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:23.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:23.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080843 -lt 1617080902 ]] 2021-03-30T05:07:23.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:23.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:23.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:23.824 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.824 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:23.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:23.826 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:23.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:23.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:23.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080843 -lt 1617080902 ]] 2021-03-30T05:07:23.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:23.828 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:24.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:24.044 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:24.045 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:24.045 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:24.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:24.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:24.048 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:24.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080844 -lt 1617080902 ]] 2021-03-30T05:07:24.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:24.049 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:24.261 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:24.262 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:24.262 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:24.263 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:24.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:24.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:24.265 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:24.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080844 -lt 1617080902 ]] 2021-03-30T05:07:24.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:24.266 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:24.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:24.480 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:24.480 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:24.480 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:24.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:24.483 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:24.483 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:24.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080844 -lt 1617080902 ]] 2021-03-30T05:07:24.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:24.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:27.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:27.702 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:27.703 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:27.703 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:27.705 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:27.705 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:27.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:27.706 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080847 -lt 1617080902 ]] 2021-03-30T05:07:27.706 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:27.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:27.919 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:27.920 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:27.920 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:27.920 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:27.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:27.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:27.923 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:27.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080847 -lt 1617080902 ]] 2021-03-30T05:07:27.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:27.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:28.134 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:28.135 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.135 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:28.136 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.137 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:28.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:28.138 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:28.139 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080848 -lt 1617080902 ]] 2021-03-30T05:07:28.139 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:28.139 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:28.352 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:28.352 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.353 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:28.353 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.355 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:28.355 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:28.356 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:28.356 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080848 -lt 1617080902 ]] 2021-03-30T05:07:28.357 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:28.357 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:28.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:28.568 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.568 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:28.569 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:28.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:28.571 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:28.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080848 -lt 1617080902 ]] 2021-03-30T05:07:28.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:28.572 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:28.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:28.785 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.786 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:28.786 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:28.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:28.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:28.789 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:28.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080848 -lt 1617080902 ]] 2021-03-30T05:07:28.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:28.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:29.001 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:29.002 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:29.003 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:29.003 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:29.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:29.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:29.005 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:29.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080849 -lt 1617080902 ]] 2021-03-30T05:07:29.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:29.006 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:29.218 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:29.218 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:29.219 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:29.220 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:29.222 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:29.222 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:29.223 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:29.223 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080849 -lt 1617080902 ]] 2021-03-30T05:07:29.224 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:29.224 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:29.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:29.434 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:29.435 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:29.435 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3],"quorum_names":["a","b","c","d"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:29.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:29.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:29.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:29.438 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080849 -lt 1617080902 ]] 2021-03-30T05:07:29.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:07:29.439 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:37.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:37.738 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:37.738 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:07:37.739 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:14.305066Z","created":"2021-03-30T05:07:14.305066Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:37.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=true 2021-03-30T05:07:37.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ true == \t\r\u\e ]] 2021-03-30T05:07:37.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: wait_for_quorum: no_quorum=0 2021-03-30T05:07:37.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: wait_for_quorum: break 2021-03-30T05:07:37.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: wait_for_quorum: return 0 2021-03-30T05:07:37.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:129: TEST_4_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:07:40.957 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,d) after stopping [a] 2021-03-30T05:07:40.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:130: TEST_4_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:07:41.124 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons [b] 2021-03-30T05:07:41.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:131: TEST_4_mons_checks: ceph mon ok-to-stop c 2021-03-30T05:07:44.286 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (b,d) after stopping mons [c] 2021-03-30T05:07:44.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:132: TEST_4_mons_checks: ceph mon ok-to-stop d 2021-03-30T05:07:44.465 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (b,c) after stopping mons [d] 2021-03-30T05:07:44.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:134: TEST_4_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:07:44.684 INFO:tasks.workunit.client.0.smithi197.stderr:adding another mon that is not yet online will not break quorum 2021-03-30T05:07:44.692 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:136: TEST_4_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:07:44.910 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.a 2021-03-30T05:07:44.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:137: TEST_4_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:07:45.128 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.b 2021-03-30T05:07:45.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:138: TEST_4_mons_checks: ceph mon ok-to-rm c 2021-03-30T05:07:45.343 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.c 2021-03-30T05:07:45.351 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:139: TEST_4_mons_checks: ceph mon ok-to-rm d 2021-03-30T05:07:45.583 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.d 2021-03-30T05:07:45.591 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2021-03-30T05:07:45.592 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:45.592 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:45.592 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:45.592 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:45.593 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:45.698 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:45.698 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2021-03-30T05:07:45.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:07:45.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:07:45.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:07:45.699 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:45.700 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:45.700 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:45.700 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:45.700 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:45.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:45.703 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:07:45.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:07:45.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:07:45.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:07:45.705 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:07:45.705 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:07:45.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:45.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:07:45.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:07:45.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:45.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:07:45.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:07:45.709 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:07:45.713 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:07:45.713 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:45.713 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:45.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:07:45.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:07:45.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:07:45.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:19: run: for func in $funcs 2021-03-30T05:07:45.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:20: run: setup td/ok-to-stop 2021-03-30T05:07:45.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ok-to-stop 2021-03-30T05:07:45.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ok-to-stop 2021-03-30T05:07:45.717 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:07:45.717 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:07:45.717 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:07:45.717 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:45.717 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:45.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:45.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:45.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:45.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:45.720 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:07:45.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:07:45.720 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:07:45.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:07:45.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:07:45.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:07:45.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:45.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:07:45.723 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:07:45.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:07:45.723 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:07:45.723 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:07:45.723 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:07:45.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:07:45.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:45.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:45.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:07:45.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:07:45.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:07:45.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ok-to-stop 2021-03-30T05:07:45.728 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:07:45.728 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:45.728 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:45.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.30648 2021-03-30T05:07:45.728 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:07:45.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:07:45.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:07:45.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ok-to-stop 1' TERM HUP INT 2021-03-30T05:07:45.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:21: run: TEST_5_mons_checks td/ok-to-stop 2021-03-30T05:07:45.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:143: TEST_5_mons_checks: local dir=td/ok-to-stop 2021-03-30T05:07:45.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:145: TEST_5_mons_checks: CEPH_ARGS='--fsid=cca76e7c-8de9-4fa3-bfcd-67ceed319738 --auth-supported=none --mon-host=127.0.0.1:7150,127.0.0.1:7151,127.0.0.1:7152,127.0.0.1:7153,127.0.0.1:7154 ' 2021-03-30T05:07:45.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:147: TEST_5_mons_checks: run_mon td/ok-to-stop a --public-addr=127.0.0.1:7150 2021-03-30T05:07:45.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:45.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:45.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:07:45.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:45.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/a 2021-03-30T05:07:45.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ok-to-stop/a --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7150 2021-03-30T05:07:46.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:46.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:46.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:46.042 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:46.042 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:46.042 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:46.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:46.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/a '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7150 2021-03-30T05:07:46.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:46.210 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:07:46.210 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:46.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:07:46.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:46.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:46.211 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:07:46.212 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:07:46.212 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:07:46.212 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:46.212 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:46.212 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:46.213 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:07:46.213 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:46.213 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get fsid 2021-03-30T05:07:46.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:07:46.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:46.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:07:46.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:46.298 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:46.298 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:07:46.298 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:07:46.298 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:07:46.299 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:46.299 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:46.299 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:46.299 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.a.asok 2021-03-30T05:07:46.299 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:46.300 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.a.asok config get mon_host 2021-03-30T05:07:46.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:148: TEST_5_mons_checks: run_mon td/ok-to-stop b --public-addr=127.0.0.1:7151 2021-03-30T05:07:46.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:46.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:46.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=b 2021-03-30T05:07:46.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:46.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/b 2021-03-30T05:07:46.384 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id b --mkfs --mon-data=td/ok-to-stop/b --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7151 2021-03-30T05:07:46.654 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:46.655 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:46.655 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:46.655 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:46.655 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:46.656 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:46.656 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:46.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id b --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/b '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7151 2021-03-30T05:07:46.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:46.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b fsid 2021-03-30T05:07:46.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:46.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:07:46.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:46.848 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:46.848 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:07:46.848 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:07:46.848 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:07:46.848 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:46.849 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:46.849 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:46.849 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:07:46.849 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:46.849 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get fsid 2021-03-30T05:07:46.934 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon b mon_host 2021-03-30T05:07:46.934 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:46.934 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=b 2021-03-30T05:07:46.935 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:46.935 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:46.935 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.b 2021-03-30T05:07:46.935 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.b 2021-03-30T05:07:46.936 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.b ']' 2021-03-30T05:07:46.936 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:46.936 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:46.936 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:46.936 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.b.asok 2021-03-30T05:07:46.937 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:46.937 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.b.asok config get mon_host 2021-03-30T05:07:47.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:149: TEST_5_mons_checks: run_mon td/ok-to-stop c --public-addr=127.0.0.1:7152 2021-03-30T05:07:47.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:47.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:47.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=c 2021-03-30T05:07:47.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:47.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/c 2021-03-30T05:07:47.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id c --mkfs --mon-data=td/ok-to-stop/c --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7152 2021-03-30T05:07:47.330 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:47.330 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:47.330 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:47.331 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:47.331 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:47.331 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:47.331 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:47.332 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id c --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/c '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7152 2021-03-30T05:07:47.498 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:47.500 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon c fsid 2021-03-30T05:07:47.500 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:47.500 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=c 2021-03-30T05:07:47.500 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:47.500 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:47.501 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.c 2021-03-30T05:07:47.501 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2021-03-30T05:07:47.501 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2021-03-30T05:07:47.501 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:47.501 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:47.502 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:47.502 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.c.asok 2021-03-30T05:07:47.502 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:47.502 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.c.asok config get fsid 2021-03-30T05:07:47.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon c mon_host 2021-03-30T05:07:47.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:47.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=c 2021-03-30T05:07:47.587 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:47.587 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:47.587 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.c 2021-03-30T05:07:47.587 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.c 2021-03-30T05:07:47.588 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.c ']' 2021-03-30T05:07:47.588 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:47.588 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:47.588 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:47.588 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.c.asok 2021-03-30T05:07:47.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:47.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.c.asok config get mon_host 2021-03-30T05:07:47.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:150: TEST_5_mons_checks: run_mon td/ok-to-stop d --public-addr=127.0.0.1:7153 2021-03-30T05:07:47.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:47.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:47.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=d 2021-03-30T05:07:47.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:47.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/d 2021-03-30T05:07:47.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id d --mkfs --mon-data=td/ok-to-stop/d --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7153 2021-03-30T05:07:47.966 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:47.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:47.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:47.967 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:47.967 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:47.968 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:47.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:47.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id d --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/d '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7153 2021-03-30T05:07:48.109 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:48.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon d fsid 2021-03-30T05:07:48.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:48.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=d 2021-03-30T05:07:48.112 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:48.112 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:48.112 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.d 2021-03-30T05:07:48.112 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2021-03-30T05:07:48.112 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2021-03-30T05:07:48.113 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:48.113 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:48.113 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:48.113 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.d.asok 2021-03-30T05:07:48.113 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:48.114 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.d.asok config get fsid 2021-03-30T05:07:48.197 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon d mon_host 2021-03-30T05:07:48.197 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:48.197 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=d 2021-03-30T05:07:48.198 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:48.198 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:48.198 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.d 2021-03-30T05:07:48.198 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.d 2021-03-30T05:07:48.198 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.d ']' 2021-03-30T05:07:48.199 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:48.199 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:48.199 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:48.199 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.d.asok 2021-03-30T05:07:48.200 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:48.200 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.d.asok config get mon_host 2021-03-30T05:07:48.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:151: TEST_5_mons_checks: run_mon td/ok-to-stop e --public-addr=127.0.0.1:7154 2021-03-30T05:07:48.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ok-to-stop 2021-03-30T05:07:48.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:07:48.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=e 2021-03-30T05:07:48.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:07:48.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ok-to-stop/e 2021-03-30T05:07:48.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id e --mkfs --mon-data=td/ok-to-stop/e --run-dir=td/ok-to-stop --public-addr=127.0.0.1:7154 2021-03-30T05:07:48.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:07:48.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:07:48.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:07:48.613 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:07:48.613 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:48.613 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:48.613 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.30648/$cluster-$name.asok' 2021-03-30T05:07:48.614 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id e --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ok-to-stop/e '--log-file=td/ok-to-stop/$name.log' '--admin-socket=/tmp/ceph-asok.30648/$cluster-$name.asok' --mon-cluster-log-file=td/ok-to-stop/log --run-dir=td/ok-to-stop '--pid-file=td/ok-to-stop/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --public-addr=127.0.0.1:7154 2021-03-30T05:07:48.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:07:48.764 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon e fsid 2021-03-30T05:07:48.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:48.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=e 2021-03-30T05:07:48.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:07:48.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:07:48.765 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.e 2021-03-30T05:07:48.766 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.e 2021-03-30T05:07:48.766 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.e ']' 2021-03-30T05:07:48.766 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:48.766 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:48.766 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:48.767 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.e.asok 2021-03-30T05:07:48.767 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:48.767 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.e.asok config get fsid 2021-03-30T05:07:48.850 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon e mon_host 2021-03-30T05:07:48.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:07:48.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=e 2021-03-30T05:07:48.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:07:48.852 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:07:48.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.e 2021-03-30T05:07:48.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.e 2021-03-30T05:07:48.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.e ']' 2021-03-30T05:07:48.852 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:07:48.853 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:07:48.853 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:07:48.853 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.30648/ceph-mon.e.asok 2021-03-30T05:07:48.853 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:07:48.853 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.30648/ceph-mon.e.asok config get mon_host 2021-03-30T05:07:48.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:152: TEST_5_mons_checks: wait_for_quorum 60 5 2021-03-30T05:07:48.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: wait_for_quorum: local timeout=60 2021-03-30T05:07:48.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: wait_for_quorum: local quorumsize=5 2021-03-30T05:07:48.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: wait_for_quorum: [[ -z 60 ]] 2021-03-30T05:07:48.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: wait_for_quorum: [[ -z 5 ]] 2021-03-30T05:07:48.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: wait_for_quorum: no_quorum=1 2021-03-30T05:07:48.939 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: date +%s 2021-03-30T05:07:48.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: wait_until=1617080928 2021-03-30T05:07:48.940 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:48.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080868 -lt 1617080928 ]] 2021-03-30T05:07:48.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 5' 2021-03-30T05:07:48.941 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:52.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:52.160 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:52.160 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 5' 2021-03-30T05:07:52.161 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:52.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=true 2021-03-30T05:07:52.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ true == \t\r\u\e ]] 2021-03-30T05:07:52.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: wait_for_quorum: no_quorum=0 2021-03-30T05:07:52.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: wait_for_quorum: break 2021-03-30T05:07:52.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: wait_for_quorum: return 0 2021-03-30T05:07:52.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:154: TEST_5_mons_checks: ceph mon ok-to-stop dne 2021-03-30T05:07:52.386 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,c,d,e) after stopping [dne] 2021-03-30T05:07:52.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:155: TEST_5_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:07:52.612 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,d,e) after stopping [a] 2021-03-30T05:07:52.620 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:156: TEST_5_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:07:52.878 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,c,d,e) after stopping [b] 2021-03-30T05:07:52.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:157: TEST_5_mons_checks: ceph mon ok-to-stop c 2021-03-30T05:07:53.163 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,d,e) after stopping [c] 2021-03-30T05:07:53.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:158: TEST_5_mons_checks: ceph mon ok-to-stop d 2021-03-30T05:07:53.379 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,c,e) after stopping [d] 2021-03-30T05:07:53.387 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:159: TEST_5_mons_checks: ceph mon ok-to-stop e 2021-03-30T05:07:53.596 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,c,d) after stopping [e] 2021-03-30T05:07:53.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:160: TEST_5_mons_checks: ceph mon ok-to-stop a b 2021-03-30T05:07:53.812 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (c,d,e) after stopping [a,b] 2021-03-30T05:07:53.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:161: TEST_5_mons_checks: ceph mon ok-to-stop c d 2021-03-30T05:07:54.029 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (a,b,e) after stopping [c,d] 2021-03-30T05:07:54.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:162: TEST_5_mons_checks: ceph mon ok-to-stop a b c 2021-03-30T05:07:54.195 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (d,e) after stopping mons [a,b,c] 2021-03-30T05:07:54.196 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:164: TEST_5_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:07:54.431 INFO:tasks.workunit.client.0.smithi197.stderr:adding another mon that is not yet online will not break quorum 2021-03-30T05:07:54.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:166: TEST_5_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:07:54.657 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.a 2021-03-30T05:07:54.665 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:167: TEST_5_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:07:54.951 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.b 2021-03-30T05:07:54.959 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:168: TEST_5_mons_checks: ceph mon ok-to-rm c 2021-03-30T05:07:58.172 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.c 2021-03-30T05:07:58.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:169: TEST_5_mons_checks: ceph mon ok-to-rm d 2021-03-30T05:07:58.389 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.d 2021-03-30T05:07:58.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:170: TEST_5_mons_checks: ceph mon ok-to-rm e 2021-03-30T05:07:58.643 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.e 2021-03-30T05:07:58.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:172: TEST_5_mons_checks: kill_daemons td/ok-to-stop KILL mon.a 2021-03-30T05:07:58.652 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:07:58.652 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:07:58.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:07:58.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:07:58.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:07:58.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:07:58.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:173: TEST_5_mons_checks: wait_for_quorum 60 4 2021-03-30T05:07:58.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: wait_for_quorum: local timeout=60 2021-03-30T05:07:58.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: wait_for_quorum: local quorumsize=4 2021-03-30T05:07:58.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: wait_for_quorum: [[ -z 60 ]] 2021-03-30T05:07:58.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: wait_for_quorum: [[ -z 4 ]] 2021-03-30T05:07:58.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: wait_for_quorum: no_quorum=1 2021-03-30T05:07:58.759 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: date +%s 2021-03-30T05:07:58.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: wait_until=1617080938 2021-03-30T05:07:58.759 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:58.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080878 -lt 1617080938 ]] 2021-03-30T05:07:58.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:07:58.760 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:58.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:58.973 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:58.973 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:07:58.974 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:58.975 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:58.976 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:58.976 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:58.977 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080878 -lt 1617080938 ]] 2021-03-30T05:07:58.977 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:07:58.977 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:59.189 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:59.190 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.190 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:07:59.191 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:59.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:59.193 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:59.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080879 -lt 1617080938 ]] 2021-03-30T05:07:59.194 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:07:59.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:59.405 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:59.406 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.407 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:07:59.407 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:59.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:59.409 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:59.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080879 -lt 1617080938 ]] 2021-03-30T05:07:59.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:07:59.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:59.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:59.621 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.622 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:07:59.622 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:59.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:59.624 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:59.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080879 -lt 1617080938 ]] 2021-03-30T05:07:59.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:07:59.626 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:07:59.838 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:07:59.838 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.839 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:07:59.839 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:07:59.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:07:59.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:07:59.841 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:07:59.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080879 -lt 1617080938 ]] 2021-03-30T05:07:59.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:07:59.842 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:00.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:00.055 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:00.056 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:00.056 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:00.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:00.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:00.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:00.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080880 -lt 1617080938 ]] 2021-03-30T05:08:00.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:00.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:00.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:00.271 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:00.272 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:00.272 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:00.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:00.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:00.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:00.275 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080880 -lt 1617080938 ]] 2021-03-30T05:08:00.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:00.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:03.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:03.493 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:03.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:03.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:03.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:03.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:03.497 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:03.497 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080883 -lt 1617080938 ]] 2021-03-30T05:08:03.498 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:03.498 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:06.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:06.716 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:06.717 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:06.717 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:06.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:06.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:06.719 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:06.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080886 -lt 1617080938 ]] 2021-03-30T05:08:06.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:06.720 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:06.932 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:06.932 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:06.933 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:06.933 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:06.935 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:06.935 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:06.935 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:06.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080886 -lt 1617080938 ]] 2021-03-30T05:08:06.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:06.937 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:07.148 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:07.149 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:07.150 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.151 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:07.151 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:07.152 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:07.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080887 -lt 1617080938 ]] 2021-03-30T05:08:07.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:07.153 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:07.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:07.365 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.366 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:07.366 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:07.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:07.374 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:07.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080887 -lt 1617080938 ]] 2021-03-30T05:08:07.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:07.375 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:07.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:07.581 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.582 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:07.582 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:07.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:07.584 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:07.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080887 -lt 1617080938 ]] 2021-03-30T05:08:07.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:07.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:07.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:07.798 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:07.799 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:07.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:07.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:07.801 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:07.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080887 -lt 1617080938 ]] 2021-03-30T05:08:07.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:07.802 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:08.013 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:08.014 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:08.014 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:08.015 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:08.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:08.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:08.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:08.017 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080888 -lt 1617080938 ]] 2021-03-30T05:08:08.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:08.018 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:08.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:08.232 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:08.233 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:08.233 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:08.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:08.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:08.236 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:08.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080888 -lt 1617080938 ]] 2021-03-30T05:08:08.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:08.237 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:08.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:08.447 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:08.448 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:08.448 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":4,"quorum":[0,1,2,3,4],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:08.450 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:08.450 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:08.450 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:08.451 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080888 -lt 1617080938 ]] 2021-03-30T05:08:08.451 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 4' 2021-03-30T05:08:08.452 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:13.768 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:13.769 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:13.770 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 4' 2021-03-30T05:08:13.770 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:13.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=true 2021-03-30T05:08:13.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ true == \t\r\u\e ]] 2021-03-30T05:08:13.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: wait_for_quorum: no_quorum=0 2021-03-30T05:08:13.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: wait_for_quorum: break 2021-03-30T05:08:13.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: wait_for_quorum: return 0 2021-03-30T05:08:13.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:175: TEST_5_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:08:17.073 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,d,e) after stopping [a] 2021-03-30T05:08:17.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:176: TEST_5_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:08:17.329 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (c,d,e) after stopping [b] 2021-03-30T05:08:17.490 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:177: TEST_5_mons_checks: ceph mon ok-to-stop c 2021-03-30T05:08:17.562 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,d,e) after stopping [c] 2021-03-30T05:08:17.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:178: TEST_5_mons_checks: ceph mon ok-to-stop d 2021-03-30T05:08:17.788 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,e) after stopping [d] 2021-03-30T05:08:17.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:179: TEST_5_mons_checks: ceph mon ok-to-stop e 2021-03-30T05:08:18.012 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,d) after stopping [e] 2021-03-30T05:08:18.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:181: TEST_5_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:08:18.247 INFO:tasks.workunit.client.0.smithi197.stderr:adding another mon that is not yet online will not break quorum 2021-03-30T05:08:18.255 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:183: TEST_5_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:08:18.476 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.a 2021-03-30T05:08:18.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:184: TEST_5_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:08:18.740 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.b 2021-03-30T05:08:18.748 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:185: TEST_5_mons_checks: ceph mon ok-to-rm c 2021-03-30T05:08:19.016 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.c 2021-03-30T05:08:19.024 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:186: TEST_5_mons_checks: ceph mon ok-to-rm d 2021-03-30T05:08:22.238 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.d 2021-03-30T05:08:22.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:187: TEST_5_mons_checks: ceph mon ok-to-rm e 2021-03-30T05:08:22.454 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.e 2021-03-30T05:08:22.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:189: TEST_5_mons_checks: kill_daemons td/ok-to-stop KILL mon.e 2021-03-30T05:08:22.463 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:08:22.463 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:08:22.463 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:08:22.463 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:08:22.464 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:08:22.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:08:22.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:190: TEST_5_mons_checks: wait_for_quorum 60 3 2021-03-30T05:08:22.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:993: wait_for_quorum: local timeout=60 2021-03-30T05:08:22.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:994: wait_for_quorum: local quorumsize=3 2021-03-30T05:08:22.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:996: wait_for_quorum: [[ -z 60 ]] 2021-03-30T05:08:22.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1000: wait_for_quorum: [[ -z 3 ]] 2021-03-30T05:08:22.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1005: wait_for_quorum: no_quorum=1 2021-03-30T05:08:22.570 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: date +%s 2021-03-30T05:08:22.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1006: wait_for_quorum: wait_until=1617080962 2021-03-30T05:08:22.570 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:22.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080902 -lt 1617080962 ]] 2021-03-30T05:08:22.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:22.572 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:25.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:25.789 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:25.789 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:25.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:25.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:25.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:25.792 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:25.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080905 -lt 1617080962 ]] 2021-03-30T05:08:25.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:25.793 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:26.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:26.006 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.007 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:26.007 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:26.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:26.010 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:26.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080906 -lt 1617080962 ]] 2021-03-30T05:08:26.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:26.011 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:26.224 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:26.224 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.225 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:26.225 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.227 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:26.227 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:26.227 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:26.228 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080906 -lt 1617080962 ]] 2021-03-30T05:08:26.228 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:26.229 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:26.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:26.441 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.441 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:26.442 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:26.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:26.444 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:26.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080906 -lt 1617080962 ]] 2021-03-30T05:08:26.445 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:26.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:26.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:26.657 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.657 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:26.658 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":12,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.659 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:26.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:26.660 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:26.661 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080906 -lt 1617080962 ]] 2021-03-30T05:08:26.661 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:26.661 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:26.872 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:26.872 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.873 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:26.873 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:26.875 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:26.875 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:26.876 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:26.876 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080906 -lt 1617080962 ]] 2021-03-30T05:08:26.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:26.877 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:27.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:27.089 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:27.089 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:27.090 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":13,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:27.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:27.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:27.092 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:27.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080907 -lt 1617080962 ]] 2021-03-30T05:08:27.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:27.093 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:30.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:30.313 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:30.314 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.315 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:30.315 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:30.316 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:30.317 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080910 -lt 1617080962 ]] 2021-03-30T05:08:30.317 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:30.317 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:30.530 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:30.530 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.531 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:30.531 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":16,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:30.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:30.533 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:30.534 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080910 -lt 1617080962 ]] 2021-03-30T05:08:30.534 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:30.535 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:30.747 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:30.747 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.748 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:30.748 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.750 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:30.751 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:30.751 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:30.752 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080910 -lt 1617080962 ]] 2021-03-30T05:08:30.752 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:30.752 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:30.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:30.963 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:30.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:30.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:30.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:30.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:30.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080910 -lt 1617080962 ]] 2021-03-30T05:08:30.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:30.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:31.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:31.180 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:31.181 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:31.181 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:31.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:31.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:31.183 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:31.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080911 -lt 1617080962 ]] 2021-03-30T05:08:31.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:31.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:31.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:31.396 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:31.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:31.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:31.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:31.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:31.399 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:31.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080911 -lt 1617080962 ]] 2021-03-30T05:08:31.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:31.400 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:31.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:31.611 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:31.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:31.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":6,"quorum":[1,2,3,4],"quorum_names":["b","c","d","e"],"quorum_leader_name":"b","quorum_age":17,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:31.614 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=false 2021-03-30T05:08:31.614 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ false == \t\r\u\e ]] 2021-03-30T05:08:31.615 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: date +%s 2021-03-30T05:08:31.615 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1007: wait_for_quorum: [[ 1617080911 -lt 1617080962 ]] 2021-03-30T05:08:31.616 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1008: wait_for_quorum: jqfilter='.quorum | length == 3' 2021-03-30T05:08:31.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: timeout 60 ceph quorum_status --format=json 2021-03-30T05:08:37.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1009: wait_for_quorum: jqinput=' 2021-03-30T05:08:37.841 INFO:tasks.workunit.client.0.smithi197.stderr:{"election_epoch":10,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:37.842 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: jq '.quorum | length == 3' 2021-03-30T05:08:37.842 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: echo '{"election_epoch":10,"quorum":[1,2,3],"quorum_names":["b","c","d"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138292840890367","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"]},"monmap":{"epoch":1,"fsid":"cca76e7c-8de9-4fa3-bfcd-67ceed319738","modified":"2021-03-30T05:07:45.742907Z","created":"2021-03-30T05:07:45.742907Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7150","nonce":0}]},"addr":"127.0.0.1:7150/0","public_addr":"127.0.0.1:7150/0","priority":0,"weight":0},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7151","nonce":0}]},"addr":"127.0.0.1:7151/0","public_addr":"127.0.0.1:7151/0","priority":0,"weight":0},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7152","nonce":0}]},"addr":"127.0.0.1:7152/0","public_addr":"127.0.0.1:7152/0","priority":0,"weight":0},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7153","nonce":0}]},"addr":"127.0.0.1:7153/0","public_addr":"127.0.0.1:7153/0","priority":0,"weight":0},{"rank":4,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"127.0.0.1:7154","nonce":0}]},"addr":"127.0.0.1:7154/0","public_addr":"127.0.0.1:7154/0","priority":0,"weight":0}]}}' 2021-03-30T05:08:37.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1010: wait_for_quorum: res=true 2021-03-30T05:08:37.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1011: wait_for_quorum: [[ true == \t\r\u\e ]] 2021-03-30T05:08:37.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: wait_for_quorum: no_quorum=0 2021-03-30T05:08:37.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: wait_for_quorum: break 2021-03-30T05:08:37.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: wait_for_quorum: return 0 2021-03-30T05:08:37.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:192: TEST_5_mons_checks: ceph mon ok-to-stop a 2021-03-30T05:08:38.053 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,d) after stopping [a] 2021-03-30T05:08:38.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:193: TEST_5_mons_checks: ceph mon ok-to-stop b 2021-03-30T05:08:38.219 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (c,d) after stopping mons [b] 2021-03-30T05:08:38.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:194: TEST_5_mons_checks: ceph mon ok-to-stop c 2021-03-30T05:08:38.407 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (b,d) after stopping mons [c] 2021-03-30T05:08:38.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:195: TEST_5_mons_checks: ceph mon ok-to-stop d 2021-03-30T05:08:41.571 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: not enough monitors would be available (b,c) after stopping mons [d] 2021-03-30T05:08:41.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:196: TEST_5_mons_checks: ceph mon ok-to-stop e 2021-03-30T05:08:44.788 INFO:tasks.workunit.client.0.smithi197.stderr:quorum should be preserved (b,c,d) after stopping [e] 2021-03-30T05:08:44.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:198: TEST_5_mons_checks: ceph mon ok-to-add-offline 2021-03-30T05:08:45.034 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: adding a monitor may break quorum (until that monitor starts) 2021-03-30T05:08:45.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:200: TEST_5_mons_checks: ceph mon ok-to-rm a 2021-03-30T05:08:45.252 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.a 2021-03-30T05:08:45.260 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:201: TEST_5_mons_checks: ceph mon ok-to-rm b 2021-03-30T05:08:45.435 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: removing mon.b would break quorum 2021-03-30T05:08:45.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:202: TEST_5_mons_checks: ceph mon ok-to-rm c 2021-03-30T05:08:45.605 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: removing mon.c would break quorum 2021-03-30T05:08:45.607 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:203: TEST_5_mons_checks: ceph mon ok-to-rm d 2021-03-30T05:08:45.777 INFO:tasks.workunit.client.0.smithi197.stderr:Error EBUSY: removing mon.d would break quorum 2021-03-30T05:08:45.779 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:204: TEST_5_mons_checks: ceph mon ok-to-rm e 2021-03-30T05:08:45.987 INFO:tasks.workunit.client.0.smithi197.stderr:safe to remove mon.e 2021-03-30T05:08:45.995 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:22: run: kill_daemons td/ok-to-stop KILL 2021-03-30T05:08:45.996 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:08:45.996 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:08:45.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:08:45.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:08:45.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:08:46.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:08:46.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh:23: run: teardown td/ok-to-stop 2021-03-30T05:08:46.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:08:46.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:08:46.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:08:46.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:08:46.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:08:46.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:08:46.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:08:46.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:08:46.108 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:08:46.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:08:46.109 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:08:46.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:08:46.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:08:46.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:08:46.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:08:46.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:08:46.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:08:46.113 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:08:46.113 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:08:46.113 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:08:46.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:08:46.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:08:46.120 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:08:46.120 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:46.121 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:08:46.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:08:46.122 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:08:46.123 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:08:46.123 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2021-03-30T05:08:46.123 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/ok-to-stop 0 2021-03-30T05:08:46.123 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ok-to-stop 2021-03-30T05:08:46.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2021-03-30T05:08:46.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ok-to-stop KILL 2021-03-30T05:08:46.124 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:08:46.124 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:08:46.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:08:46.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:08:46.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:08:46.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:08:46.126 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:08:46.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:08:46.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:08:46.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:08:46.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:08:46.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:08:46.128 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:08:46.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:08:46.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:08:46.129 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:08:46.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:08:46.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2021-03-30T05:08:46.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ok-to-stop 2021-03-30T05:08:46.131 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:08:46.131 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:46.132 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.30648 2021-03-30T05:08:46.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.30648 2021-03-30T05:08:46.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:08:46.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:08:46.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2021-03-30T05:08:46.134 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-03-30T05:08:46.135 DEBUG:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-03-30T05:08:46.199 INFO:tasks.workunit:Running workunit misc/rados-striper.sh... 2021-03-30T05:08:46.200 DEBUG:teuthology.orchestra.run.smithi197:workunit test misc/rados-striper.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e4949d651265114d7b464cd1e8986d9a31a26071 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh 2021-03-30T05:08:46.259 INFO:tasks.workunit.client.0.smithi197.stderr:stty: 'standard input': Inappropriate ioctl for device 2021-03-30T05:08:46.268 INFO:tasks.workunit.client.0.smithi197.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2021-03-30T05:08:46.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2021-03-30T05:08:46.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2144: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2021-03-30T05:08:46.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: export PYTHONWARNINGS=ignore 2021-03-30T05:08:46.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2145: main: PYTHONWARNINGS=ignore 2021-03-30T05:08:46.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: export CEPH_CONF=/dev/null 2021-03-30T05:08:46.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2146: main: CEPH_CONF=/dev/null 2021-03-30T05:08:46.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2147: main: unset CEPH_ARGS 2021-03-30T05:08:46.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2149: main: local code 2021-03-30T05:08:46.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2150: main: run td/rados-striper 2021-03-30T05:08:46.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:20: run: local dir=td/rados-striper 2021-03-30T05:08:46.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:21: run: shift 2021-03-30T05:08:46.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:23: run: export CEPH_MON=127.0.0.1:7116 2021-03-30T05:08:46.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:23: run: CEPH_MON=127.0.0.1:7116 2021-03-30T05:08:46.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:24: run: export CEPH_ARGS 2021-03-30T05:08:46.271 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:25: run: uuidgen 2021-03-30T05:08:46.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:25: run: CEPH_ARGS+='--fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none ' 2021-03-30T05:08:46.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7116 ' 2021-03-30T05:08:46.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:29: run: setup td/rados-striper 2021-03-30T05:08:46.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/rados-striper 2021-03-30T05:08:46.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/rados-striper 2021-03-30T05:08:46.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/rados-striper 2021-03-30T05:08:46.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:08:46.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/rados-striper KILL 2021-03-30T05:08:46.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:08:46.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:08:46.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:08:46.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:08:46.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:08:46.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:08:46.277 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:08:46.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:08:46.277 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:08:46.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:08:46.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:08:46.278 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:08:46.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:08:46.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:08:46.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:08:46.279 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:08:46.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:08:46.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:08:46.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/rados-striper 2021-03-30T05:08:46.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:08:46.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:46.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:08:46.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.41934 2021-03-30T05:08:46.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:08:46.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:08:46.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/rados-striper 2021-03-30T05:08:46.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:08:46.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:46.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:08:46.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.41934 2021-03-30T05:08:46.283 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:08:46.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2021-03-30T05:08:46.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2021-03-30T05:08:46.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:08:46.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/rados-striper 1' TERM HUP INT 2021-03-30T05:08:46.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:32: run: run_mon td/rados-striper a 2021-03-30T05:08:46.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/rados-striper 2021-03-30T05:08:46.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:08:46.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:08:46.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:08:46.286 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/rados-striper/a 2021-03-30T05:08:46.286 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/rados-striper/a --run-dir=td/rados-striper 2021-03-30T05:08:46.576 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:08:46.576 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:08:46.576 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:08:46.577 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:08:46.577 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:46.577 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:08:46.577 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41934/$cluster-$name.asok' 2021-03-30T05:08:46.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/rados-striper/a '--log-file=td/rados-striper/$name.log' '--admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' --mon-cluster-log-file=td/rados-striper/log --run-dir=td/rados-striper '--pid-file=td/rados-striper/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:08:46.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:08:46.861 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:08:46.862 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:08:46.862 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:08:46.862 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:08:46.862 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:08:46.863 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:08:46.863 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:08:46.863 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:08:46.863 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:08:46.863 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:46.864 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:08:46.864 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.41934/ceph-mon.a.asok 2021-03-30T05:08:46.864 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:08:46.864 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.41934/ceph-mon.a.asok config get fsid 2021-03-30T05:08:46.950 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:08:46.950 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:08:46.950 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:08:46.951 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:08:46.951 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:08:46.951 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:08:46.951 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:08:46.951 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:08:46.952 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:08:46.952 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:46.952 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:08:46.952 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.41934/ceph-mon.a.asok 2021-03-30T05:08:46.952 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:08:46.953 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.41934/ceph-mon.a.asok config get mon_host 2021-03-30T05:08:47.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:33: run: run_osd td/rados-striper 0 2021-03-30T05:08:47.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/rados-striper 2021-03-30T05:08:47.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:08:47.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:08:47.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:08:47.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/rados-striper/0 2021-03-30T05:08:47.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 ' 2021-03-30T05:08:47.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:08:47.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:08:47.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:08:47.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/rados-striper/0' 2021-03-30T05:08:47.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/rados-striper/0/journal' 2021-03-30T05:08:47.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:08:47.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:08:47.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2021-03-30T05:08:47.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:08:47.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:08:47.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:08:47.043 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:08:47.044 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:47.044 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:08:47.044 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41934/$cluster-$name.asok' 2021-03-30T05:08:47.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' 2021-03-30T05:08:47.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:08:47.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:08:47.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:08:47.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2021-03-30T05:08:47.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2021-03-30T05:08:47.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:08:47.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:08:47.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:08:47.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:08:47.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:08:47.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/rados-striper/0 2021-03-30T05:08:47.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:08:47.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=46f294eb-9610-4a9f-ba3d-5f9b3842cc4a 2021-03-30T05:08:47.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 46f294eb-9610-4a9f-ba3d-5f9b3842cc4a' 2021-03-30T05:08:47.047 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 46f294eb-9610-4a9f-ba3d-5f9b3842cc4a 2021-03-30T05:08:47.048 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:08:47.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBfsmJgoRsKAxAAv96ALorXl3jr92nDkpGYog== 2021-03-30T05:08:47.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBfsmJgoRsKAxAAv96ALorXl3jr92nDkpGYog=="}' 2021-03-30T05:08:47.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 46f294eb-9610-4a9f-ba3d-5f9b3842cc4a -i td/rados-striper/0/new.json 2021-03-30T05:08:47.970 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:08:47.979 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/rados-striper/0/new.json 2021-03-30T05:08:47.980 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/0 --osd-journal=td/rados-striper/0/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBfsmJgoRsKAxAAv96ALorXl3jr92nDkpGYog== --osd-uuid 46f294eb-9610-4a9f-ba3d-5f9b3842cc4a 2021-03-30T05:08:48.000 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:47.999+0000 7fe915c9cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:48.002 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:48.001+0000 7fe915c9cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:48.002 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:48.002+0000 7fe915c9cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:48.003 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:48.003+0000 7fe915c9cf40 -1 bluestore(td/rados-striper/0/block) _read_bdev_label failed to open td/rados-striper/0/block: (2) No such file or directory 2021-03-30T05:08:48.004 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:48.003+0000 7fe915c9cf40 -1 bluestore(td/rados-striper/0/block) _read_bdev_label failed to open td/rados-striper/0/block: (2) No such file or directory 2021-03-30T05:08:48.004 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:48.003+0000 7fe915c9cf40 -1 bluestore(td/rados-striper/0/block) _read_bdev_label failed to open td/rados-striper/0/block: (2) No such file or directory 2021-03-30T05:08:48.051 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:48.050+0000 7fe915c9cf40 -1 bluestore(td/rados-striper/0) _read_fsid unparsable uuid 2021-03-30T05:08:48.444 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:48.444+0000 7fe915c9cf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:08:51.118 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/rados-striper/0/keyring 2021-03-30T05:08:51.118 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:08:51.119 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:08:51.119 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:08:51.120 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/rados-striper/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:08:51.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:08:51.344 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:08:51.345 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/0 --osd-journal=td/rados-striper/0/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:08:51.345 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:08:51.346 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:08:51.346 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:08:51.362 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:51.362+0000 7f59f86c1f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:51.367 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:51.366+0000 7f59f86c1f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:51.369 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:51.368+0000 7f59f86c1f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:51.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:08:51.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:08:51.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:08:51.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:08:51.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:08:51.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:08:51.552 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:08:51.553 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:08:51.553 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:08:51.553 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:08:51.756 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:08:51.884 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:51.883+0000 7f59f86c1f40 -1 Falling back to public interface 2021-03-30T05:08:52.650 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:52.649+0000 7f59f86c1f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:08:52.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:08:52.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:08:52.758 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:08:52.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:08:52.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:08:52.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:08:53.013 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:08:54.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:08:54.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:08:54.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:08:54.015 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:08:54.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:08:54.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:08:54.224 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/42218,v1:127.0.0.1:6801/42218] [v2:127.0.0.1:6802/42218,v1:127.0.0.1:6803/42218] exists,up 46f294eb-9610-4a9f-ba3d-5f9b3842cc4a 2021-03-30T05:08:54.228 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:08:54.229 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:08:54.229 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:08:54.229 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:34: run: run_osd td/rados-striper 1 2021-03-30T05:08:54.229 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/rados-striper 2021-03-30T05:08:54.229 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:08:54.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:08:54.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:08:54.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/rados-striper/1 2021-03-30T05:08:54.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 ' 2021-03-30T05:08:54.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:08:54.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:08:54.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:08:54.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/rados-striper/1' 2021-03-30T05:08:54.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/rados-striper/1/journal' 2021-03-30T05:08:54.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:08:54.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:08:54.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2021-03-30T05:08:54.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:08:54.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:08:54.233 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:08:54.233 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:08:54.233 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:08:54.233 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:08:54.233 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41934/$cluster-$name.asok' 2021-03-30T05:08:54.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' 2021-03-30T05:08:54.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:08:54.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:08:54.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:08:54.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2021-03-30T05:08:54.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2021-03-30T05:08:54.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:08:54.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:08:54.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:08:54.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:08:54.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:08:54.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/rados-striper/1 2021-03-30T05:08:54.236 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:08:54.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=03a55029-0559-40df-abf0-7eb7e8c9123c 2021-03-30T05:08:54.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 03a55029-0559-40df-abf0-7eb7e8c9123c' 2021-03-30T05:08:54.237 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 03a55029-0559-40df-abf0-7eb7e8c9123c 2021-03-30T05:08:54.237 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:08:54.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBmsmJggv5RDhAAyl5aNlUHIcgWbnYFtLTzRw== 2021-03-30T05:08:54.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBmsmJggv5RDhAAyl5aNlUHIcgWbnYFtLTzRw=="}' 2021-03-30T05:08:54.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 03a55029-0559-40df-abf0-7eb7e8c9123c -i td/rados-striper/1/new.json 2021-03-30T05:08:54.550 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:08:54.560 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/rados-striper/1/new.json 2021-03-30T05:08:54.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/1 --osd-journal=td/rados-striper/1/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBmsmJggv5RDhAAyl5aNlUHIcgWbnYFtLTzRw== --osd-uuid 03a55029-0559-40df-abf0-7eb7e8c9123c 2021-03-30T05:08:54.581 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:54.581+0000 7fbbc9859f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:54.583 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:54.582+0000 7fbbc9859f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:54.584 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:54.584+0000 7fbbc9859f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:54.585 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:54.584+0000 7fbbc9859f40 -1 bluestore(td/rados-striper/1/block) _read_bdev_label failed to open td/rados-striper/1/block: (2) No such file or directory 2021-03-30T05:08:54.585 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:54.584+0000 7fbbc9859f40 -1 bluestore(td/rados-striper/1/block) _read_bdev_label failed to open td/rados-striper/1/block: (2) No such file or directory 2021-03-30T05:08:54.585 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:54.585+0000 7fbbc9859f40 -1 bluestore(td/rados-striper/1/block) _read_bdev_label failed to open td/rados-striper/1/block: (2) No such file or directory 2021-03-30T05:08:54.673 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:54.672+0000 7fbbc9859f40 -1 bluestore(td/rados-striper/1) _read_fsid unparsable uuid 2021-03-30T05:08:55.083 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:55.083+0000 7fbbc9859f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:08:57.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/rados-striper/1/keyring 2021-03-30T05:08:57.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:08:57.743 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:08:57.743 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:08:57.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/rados-striper/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:08:57.968 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:08:57.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:08:57.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:08:57.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/1 --osd-journal=td/rados-striper/1/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:08:57.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:08:57.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:08:57.986 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:57.986+0000 7f6ece0d4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:57.989 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:57.989+0000 7f6ece0d4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:57.991 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:57.991+0000 7f6ece0d4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:08:58.175 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:08:58.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:08:58.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:08:58.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:08:58.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:08:58.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:08:58.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:08:58.177 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:08:58.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:08:58.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:08:58.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:08:58.507 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:58.506+0000 7f6ece0d4f40 -1 Falling back to public interface 2021-03-30T05:08:59.271 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:08:59.270+0000 7f6ece0d4f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:08:59.381 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:08:59.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:08:59.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:08:59.382 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:08:59.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:08:59.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:08:59.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:09:00.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:09:00.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:00.638 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:09:00.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:09:00.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:00.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:09:00.849 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/42601,v1:127.0.0.1:6809/42601] [v2:127.0.0.1:6810/42601,v1:127.0.0.1:6811/42601] exists,up 03a55029-0559-40df-abf0-7eb7e8c9123c 2021-03-30T05:09:00.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:09:00.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:09:00.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:09:00.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:35: run: run_osd td/rados-striper 2 2021-03-30T05:09:00.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/rados-striper 2021-03-30T05:09:00.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:09:00.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2021-03-30T05:09:00.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:09:00.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/rados-striper/2 2021-03-30T05:09:00.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 ' 2021-03-30T05:09:00.856 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:09:00.856 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:09:00.856 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:09:00.856 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/rados-striper/2' 2021-03-30T05:09:00.856 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/rados-striper/2/journal' 2021-03-30T05:09:00.857 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:09:00.857 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:09:00.857 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/rados-striper' 2021-03-30T05:09:00.857 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:09:00.857 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:00.858 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:00.858 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:00.858 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:00.858 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:09:00.859 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.41934/$cluster-$name.asok' 2021-03-30T05:09:00.859 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' 2021-03-30T05:09:00.859 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:09:00.859 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:09:00.859 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:09:00.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/rados-striper/$name.log' 2021-03-30T05:09:00.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/rados-striper/$name.pid' 2021-03-30T05:09:00.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:09:00.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:09:00.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:00.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:09:00.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:09:00.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/rados-striper/2 2021-03-30T05:09:00.861 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:09:00.862 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=f373af83-89ff-4912-a9f8-e12778c35dac 2021-03-30T05:09:00.862 INFO:tasks.workunit.client.0.smithi197.stdout:add osd2 f373af83-89ff-4912-a9f8-e12778c35dac 2021-03-30T05:09:00.863 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 f373af83-89ff-4912-a9f8-e12778c35dac' 2021-03-30T05:09:00.863 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:09:00.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBssmJgJrWYMxAA4vFRCFA4mPlbClLkdYpxWQ== 2021-03-30T05:09:00.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBssmJgJrWYMxAA4vFRCFA4mPlbClLkdYpxWQ=="}' 2021-03-30T05:09:00.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new f373af83-89ff-4912-a9f8-e12778c35dac -i td/rados-striper/2/new.json 2021-03-30T05:09:01.148 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:09:01.157 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/rados-striper/2/new.json 2021-03-30T05:09:01.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/2 --osd-journal=td/rados-striper/2/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBssmJgJrWYMxAA4vFRCFA4mPlbClLkdYpxWQ== --osd-uuid f373af83-89ff-4912-a9f8-e12778c35dac 2021-03-30T05:09:01.179 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.178+0000 7f0e06546f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:01.180 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.180+0000 7f0e06546f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:01.182 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.181+0000 7f0e06546f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:01.183 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.182+0000 7f0e06546f40 -1 bluestore(td/rados-striper/2/block) _read_bdev_label failed to open td/rados-striper/2/block: (2) No such file or directory 2021-03-30T05:09:01.183 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.182+0000 7f0e06546f40 -1 bluestore(td/rados-striper/2/block) _read_bdev_label failed to open td/rados-striper/2/block: (2) No such file or directory 2021-03-30T05:09:01.183 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.182+0000 7f0e06546f40 -1 bluestore(td/rados-striper/2/block) _read_bdev_label failed to open td/rados-striper/2/block: (2) No such file or directory 2021-03-30T05:09:01.221 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.221+0000 7f0e06546f40 -1 bluestore(td/rados-striper/2) _read_fsid unparsable uuid 2021-03-30T05:09:01.657 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:01.657+0000 7f0e06546f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:09:04.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/rados-striper/2/keyring 2021-03-30T05:09:04.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:09:04.369 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd2 key to auth repository 2021-03-30T05:09:04.369 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2021-03-30T05:09:04.369 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/rados-striper/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:09:04.592 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:09:04.593 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2021-03-30T05:09:04.594 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --fsid=2b9656c6-697a-4e73-892b-d0f232308b36 --auth-supported=none --mon-host=127.0.0.1:7116 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/rados-striper/2 --osd-journal=td/rados-striper/2/journal --chdir= --run-dir=td/rados-striper '--admin-socket=/tmp/ceph-asok.41934/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/rados-striper/$name.log' '--pid-file=td/rados-striper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:04.594 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:09:04.594 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:09:04.594 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:09:04.611 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:04.610+0000 7ffb781f0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:04.639 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:04.638+0000 7ffb781f0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:04.640 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:04.639+0000 7ffb781f0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:04.799 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2021-03-30T05:09:04.799 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:09:04.799 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:09:04.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:09:04.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:09:04.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:04.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:09:04.801 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:04.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:04.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:09:05.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:09:05.156 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:05.156+0000 7ffb781f0f40 -1 Falling back to public interface 2021-03-30T05:09:05.914 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:05.914+0000 7ffb781f0f40 -1 osd.2 0 log_to_monitors {default=true} 2021-03-30T05:09:06.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:09:06.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:06.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:09:06.006 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:09:06.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:06.007 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:09:06.256 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:09:07.257 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:09:07.257 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:07.258 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:09:07.258 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:09:07.259 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:07.259 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:09:07.473 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/42984,v1:127.0.0.1:6817/42984] [v2:127.0.0.1:6818/42984,v1:127.0.0.1:6819/42984] exists,up f373af83-89ff-4912-a9f8-e12778c35dac 2021-03-30T05:09:07.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:09:07.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:09:07.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:09:07.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:36: run: create_rbd_pool 2021-03-30T05:09:07.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:09:07.672 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:09:07.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:09:07.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:09:08.036 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:09:08.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:09:09.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:09:10.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:39: run: dd if=/dev/urandom of=td/rados-striper/toyfile bs=1234 count=1 2021-03-30T05:09:10.044 INFO:tasks.workunit.client.0.smithi197.stderr:1+0 records in 2021-03-30T05:09:10.044 INFO:tasks.workunit.client.0.smithi197.stderr:1+0 records out 2021-03-30T05:09:10.044 INFO:tasks.workunit.client.0.smithi197.stderr:1234 bytes (1.2 kB, 1.2 KiB) copied, 5.3513e-05 s, 23.1 MB/s 2021-03-30T05:09:10.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:42: run: rados --pool rbd --striper put toyfile td/rados-striper/toyfile 2021-03-30T05:09:10.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:45: run: rados --pool rbd --striper stat toyfile 2021-03-30T05:09:10.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:45: run: cut -d , -f 2 2021-03-30T05:09:10.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:46: run: rados --pool rbd stat toyfile.0000000000000000 2021-03-30T05:09:10.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:46: run: cut -d , -f 2 2021-03-30T05:09:10.939 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:47: run: echo ' size 1234' 2021-03-30T05:09:10.939 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:48: run: diff -w td/rados-striper/stripedStat td/rados-striper/refstat 2021-03-30T05:09:10.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:49: run: diff -w td/rados-striper/stat td/rados-striper/refstat 2021-03-30T05:09:10.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:50: run: rados --pool rbd stat toyfile 2021-03-30T05:09:10.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:51: run: grep -q 'No such file or directory' td/rados-striper/staterror 2021-03-30T05:09:10.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:54: run: rados --pool rbd --striper get toyfile td/rados-striper/stripedGroup 2021-03-30T05:09:11.189 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:55: run: diff -w td/rados-striper/toyfile td/rados-striper/stripedGroup 2021-03-30T05:09:11.190 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:56: run: rados --pool rbd get toyfile.0000000000000000 td/rados-striper/nonSTripedGroup 2021-03-30T05:09:11.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:57: run: diff -w td/rados-striper/toyfile td/rados-striper/nonSTripedGroup 2021-03-30T05:09:11.214 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:60: run: rados --pool rbd --striper truncate toyfile 12 2021-03-30T05:09:11.675 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:61: run: rados --pool rbd --striper stat toyfile 2021-03-30T05:09:11.676 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:61: run: cut -d , -f 2 2021-03-30T05:09:11.701 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:62: run: rados --pool rbd stat toyfile.0000000000000000 2021-03-30T05:09:11.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:62: run: cut -d , -f 2 2021-03-30T05:09:11.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:63: run: echo ' size 12' 2021-03-30T05:09:11.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:64: run: diff -w td/rados-striper/stripedStat td/rados-striper/reftrunc 2021-03-30T05:09:11.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:65: run: diff -w td/rados-striper/stat td/rados-striper/reftrunc 2021-03-30T05:09:11.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:69: run: rados --pool rbd --striper setxattr toyfile somexattr somevalue 2021-03-30T05:09:11.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:70: run: rados --pool rbd --striper getxattr toyfile somexattr 2021-03-30T05:09:11.874 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:71: run: rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2021-03-30T05:09:11.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:72: run: echo somevalue 2021-03-30T05:09:11.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:73: run: diff -w td/rados-striper/xattrvalue td/rados-striper/refvalue 2021-03-30T05:09:11.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:74: run: diff -w td/rados-striper/xattrvalue2 td/rados-striper/refvalue 2021-03-30T05:09:11.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:75: run: rados --pool rbd --striper listxattr toyfile 2021-03-30T05:09:11.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:76: run: echo somexattr 2021-03-30T05:09:11.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:77: run: diff -w td/rados-striper/xattrlist td/rados-striper/reflist 2021-03-30T05:09:11.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:78: run: rados --pool rbd listxattr toyfile.0000000000000000 2021-03-30T05:09:11.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:78: run: grep -v striper 2021-03-30T05:09:11.943 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:79: run: diff -w td/rados-striper/xattrlist2 td/rados-striper/reflist 2021-03-30T05:09:11.944 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:80: run: rados --pool rbd --striper rmxattr toyfile somexattr 2021-03-30T05:09:12.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:82: run: local 'attr_not_found_str=No data available' 2021-03-30T05:09:12.052 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:83: run: uname 2021-03-30T05:09:12.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:83: run: '[' Linux = FreeBSD ']' 2021-03-30T05:09:12.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:85: run: expect_failure td/rados-striper 'No data available' rados --pool rbd --striper getxattr toyfile somexattr 2021-03-30T05:09:12.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/rados-striper 2021-03-30T05:09:12.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2021-03-30T05:09:12.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local 'expected=No data available' 2021-03-30T05:09:12.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2021-03-30T05:09:12.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2021-03-30T05:09:12.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: rados --pool rbd --striper getxattr toyfile somexattr 2021-03-30T05:09:12.087 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2021-03-30T05:09:12.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2021-03-30T05:09:12.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet 'No data available' td/rados-striper/out 2021-03-30T05:09:12.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2021-03-30T05:09:12.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:87: run: expect_failure td/rados-striper 'No data available' rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2021-03-30T05:09:12.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/rados-striper 2021-03-30T05:09:12.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2021-03-30T05:09:12.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local 'expected=No data available' 2021-03-30T05:09:12.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2021-03-30T05:09:12.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2021-03-30T05:09:12.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: rados --pool rbd getxattr toyfile.0000000000000000 somexattr 2021-03-30T05:09:12.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2021-03-30T05:09:12.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2021-03-30T05:09:12.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet 'No data available' td/rados-striper/out 2021-03-30T05:09:12.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2021-03-30T05:09:12.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:91: run: rados --pool rbd --striper rm toyfile 2021-03-30T05:09:12.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:92: run: expect_failure td/rados-striper 'No such file or directory' rados --pool rbd --striper stat toyfile 2021-03-30T05:09:12.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/rados-striper 2021-03-30T05:09:12.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2021-03-30T05:09:12.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local 'expected=No such file or directory' 2021-03-30T05:09:12.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2021-03-30T05:09:12.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2021-03-30T05:09:12.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: rados --pool rbd --striper stat toyfile 2021-03-30T05:09:12.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2021-03-30T05:09:12.342 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2021-03-30T05:09:12.342 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet 'No such file or directory' td/rados-striper/out 2021-03-30T05:09:12.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2021-03-30T05:09:12.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:94: run: expect_failure td/rados-striper 'No such file or directory' rados --pool rbd stat toyfile.0000000000000000 2021-03-30T05:09:12.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/rados-striper 2021-03-30T05:09:12.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2021-03-30T05:09:12.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local 'expected=No such file or directory' 2021-03-30T05:09:12.345 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2021-03-30T05:09:12.345 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2021-03-30T05:09:12.345 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: rados --pool rbd stat toyfile.0000000000000000 2021-03-30T05:09:12.363 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2021-03-30T05:09:12.364 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2021-03-30T05:09:12.364 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet 'No such file or directory' td/rados-striper/out 2021-03-30T05:09:12.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2021-03-30T05:09:12.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh:98: run: teardown td/rados-striper 2021-03-30T05:09:12.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/rados-striper 2021-03-30T05:09:12.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:12.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/rados-striper KILL 2021-03-30T05:09:12.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:12.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:12.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:12.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:12.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:12.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:12.472 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:12.473 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:12.473 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:12.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:12.474 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:12.475 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:12.475 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:12.476 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:12.476 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:12.476 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:12.477 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:12.477 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:12.478 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/rados-striper 2021-03-30T05:09:12.481 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:12.481 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:12.482 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:09:12.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.41934 2021-03-30T05:09:12.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:12.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:12.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2151: main: code=0 2021-03-30T05:09:12.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2155: main: teardown td/rados-striper 0 2021-03-30T05:09:12.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/rados-striper 2021-03-30T05:09:12.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2021-03-30T05:09:12.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/rados-striper KILL 2021-03-30T05:09:12.485 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:12.486 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:12.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:12.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:12.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:12.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:12.489 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:12.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:12.489 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:12.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:12.490 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:12.490 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:12.490 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:12.490 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:12.491 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:12.491 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:12.491 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:12.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2021-03-30T05:09:12.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/rados-striper 2021-03-30T05:09:12.493 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:12.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:12.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.41934 2021-03-30T05:09:12.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.41934 2021-03-30T05:09:12.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:12.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:12.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2156: main: return 0 2021-03-30T05:09:12.496 INFO:teuthology.orchestra.run:Running command with timeout 3600 2021-03-30T05:09:12.496 DEBUG:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2021-03-30T05:09:12.557 INFO:tasks.workunit:Running workunit misc/test-ceph-helpers.sh... 2021-03-30T05:09:12.557 DEBUG:teuthology.orchestra.run.smithi197:workunit test misc/test-ceph-helpers.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e4949d651265114d7b464cd1e8986d9a31a26071 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh 2021-03-30T05:09:12.617 INFO:tasks.workunit.client.0.smithi197.stderr:stty: 'standard input': Inappropriate ioctl for device 2021-03-30T05:09:12.624 INFO:tasks.workunit.client.0.smithi197.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2021-03-30T05:09:12.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2165: run_tests: export .:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2021-03-30T05:09:12.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh: line 2165: export: `.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin': not a valid identifier 2021-03-30T05:09:12.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2167: run_tests: export CEPH_MON=127.0.0.1:7109 2021-03-30T05:09:12.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2167: run_tests: CEPH_MON=127.0.0.1:7109 2021-03-30T05:09:12.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2168: run_tests: export CEPH_ARGS 2021-03-30T05:09:12.625 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2169: run_tests: uuidgen 2021-03-30T05:09:12.628 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2169: run_tests: CEPH_ARGS+=' --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none ' 2021-03-30T05:09:12.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2170: run_tests: CEPH_ARGS+='--mon-host=127.0.0.1:7109 ' 2021-03-30T05:09:12.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2171: run_tests: export CEPH_CONF=/dev/null 2021-03-30T05:09:12.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2171: run_tests: CEPH_CONF=/dev/null 2021-03-30T05:09:12.629 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2173: run_tests: set 2021-03-30T05:09:12.630 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2173: run_tests: sed -n -e 's/^\(test_[0-9a-z_]*\) .*/\1/p' 2021-03-30T05:09:12.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2173: run_tests: local 'funcs=test_activate_osd 2021-03-30T05:09:12.630 INFO:tasks.workunit.client.0.smithi197.stderr:test_destroy_osd 2021-03-30T05:09:12.630 INFO:tasks.workunit.client.0.smithi197.stderr:test_display_logs 2021-03-30T05:09:12.631 INFO:tasks.workunit.client.0.smithi197.stderr:test_erasure_code_plugin_exists 2021-03-30T05:09:12.631 INFO:tasks.workunit.client.0.smithi197.stderr:test_expect_failure 2021-03-30T05:09:12.631 INFO:tasks.workunit.client.0.smithi197.stderr:test_flush_pg_stats 2021-03-30T05:09:12.631 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_config 2021-03-30T05:09:12.632 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_is_making_recovery_progress 2021-03-30T05:09:12.632 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_last_scrub_stamp 2021-03-30T05:09:12.632 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_not_primary 2021-03-30T05:09:12.632 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_num_active_clean 2021-03-30T05:09:12.633 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_num_active_or_peered 2021-03-30T05:09:12.633 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_num_pgs 2021-03-30T05:09:12.633 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_osd_id_used_by_pgs 2021-03-30T05:09:12.633 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_osds 2021-03-30T05:09:12.634 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_pg 2021-03-30T05:09:12.634 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_primary 2021-03-30T05:09:12.634 INFO:tasks.workunit.client.0.smithi197.stderr:test_get_timeout_delays 2021-03-30T05:09:12.634 INFO:tasks.workunit.client.0.smithi197.stderr:test_is_clean 2021-03-30T05:09:12.634 INFO:tasks.workunit.client.0.smithi197.stderr:test_kill_daemon 2021-03-30T05:09:12.635 INFO:tasks.workunit.client.0.smithi197.stderr:test_kill_daemons 2021-03-30T05:09:12.635 INFO:tasks.workunit.client.0.smithi197.stderr:test_objectstore_tool 2021-03-30T05:09:12.635 INFO:tasks.workunit.client.0.smithi197.stderr:test_pg_scrub 2021-03-30T05:09:12.636 INFO:tasks.workunit.client.0.smithi197.stderr:test_repair 2021-03-30T05:09:12.636 INFO:tasks.workunit.client.0.smithi197.stderr:test_run_in_background 2021-03-30T05:09:12.636 INFO:tasks.workunit.client.0.smithi197.stderr:test_run_mon 2021-03-30T05:09:12.636 INFO:tasks.workunit.client.0.smithi197.stderr:test_run_osd 2021-03-30T05:09:12.637 INFO:tasks.workunit.client.0.smithi197.stderr:test_set_config 2021-03-30T05:09:12.637 INFO:tasks.workunit.client.0.smithi197.stderr:test_setup 2021-03-30T05:09:12.637 INFO:tasks.workunit.client.0.smithi197.stderr:test_teardown 2021-03-30T05:09:12.637 INFO:tasks.workunit.client.0.smithi197.stderr:test_wait_background 2021-03-30T05:09:12.637 INFO:tasks.workunit.client.0.smithi197.stderr:test_wait_for_clean 2021-03-30T05:09:12.638 INFO:tasks.workunit.client.0.smithi197.stderr:test_wait_for_health_ok 2021-03-30T05:09:12.638 INFO:tasks.workunit.client.0.smithi197.stderr:test_wait_for_osd 2021-03-30T05:09:12.638 INFO:tasks.workunit.client.0.smithi197.stderr:test_wait_for_peered 2021-03-30T05:09:12.638 INFO:tasks.workunit.client.0.smithi197.stderr:test_wait_for_scrub 2021-03-30T05:09:12.638 INFO:tasks.workunit.client.0.smithi197.stderr:test_wait_osd_id_used_by_pgs' 2021-03-30T05:09:12.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2174: run_tests: local dir=td/ceph-helpers 2021-03-30T05:09:12.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:12.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_activate_osd td/ceph-helpers 2021-03-30T05:09:12.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:883: test_activate_osd: local dir=td/ceph-helpers 2021-03-30T05:09:12.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:885: test_activate_osd: setup td/ceph-helpers 2021-03-30T05:09:12.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:12.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:12.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:12.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:12.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:12.641 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:12.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:12.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:12.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:12.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:12.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:12.643 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:12.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:12.647 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:12.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:12.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:12.648 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:12.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:12.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:12.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:12.649 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:12.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:12.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:12.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:12.649 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:12.650 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:12.650 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:12.650 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:12.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:12.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:12.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:12.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:12.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:12.652 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:12.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:12.652 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:12.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2021-03-30T05:09:12.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2021-03-30T05:09:12.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:12.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:12.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:887: test_activate_osd: run_mon td/ceph-helpers a 2021-03-30T05:09:12.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:12.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:12.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:12.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:12.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:12.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2021-03-30T05:09:12.942 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:09:12.942 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:12.943 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:12.943 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:12.943 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:12.943 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:12.944 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:12.944 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:09:13.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:09:13.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:09:13.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:13.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:13.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:09:13.095 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:09:13.095 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:13.095 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:13.095 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:13.095 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:13.096 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:13.096 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:13.096 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:13.096 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:13.096 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:09:13.179 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:09:13.179 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:13.180 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:13.180 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:09:13.180 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:09:13.180 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:13.182 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:13.182 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:13.182 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:09:13.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:888: test_activate_osd: run_mgr td/ceph-helpers x 2021-03-30T05:09:13.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:09:13.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:09:13.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:09:13.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:09:13.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:09:13.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:09:14.140 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:09:14.140 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:14.140 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:14.141 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:14.141 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:14.141 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:14.141 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:14.141 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:14.142 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:14.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:890: test_activate_osd: run_osd td/ceph-helpers 0 2021-03-30T05:09:14.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:09:14.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:09:14.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:09:14.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:09:14.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:09:14.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:09:14.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:09:14.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:09:14.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:09:14.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:09:14.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:09:14.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:09:14.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:09:14.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:09:14.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:09:14.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:14.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:14.168 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:14.169 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:14.169 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:14.169 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:14.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:14.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:09:14.170 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:09:14.170 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:09:14.170 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:09:14.170 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:09:14.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:09:14.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:09:14.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:14.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:09:14.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:09:14.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:09:14.172 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:09:14.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=5b3dde46-4da1-4b9c-b0e1-128c1edd6b8c 2021-03-30T05:09:14.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 5b3dde46-4da1-4b9c-b0e1-128c1edd6b8c' 2021-03-30T05:09:14.173 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 5b3dde46-4da1-4b9c-b0e1-128c1edd6b8c 2021-03-30T05:09:14.173 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:09:14.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQB6smJgF0+bChAAOYfNCzKQRjHN10B5AT4p4A== 2021-03-30T05:09:14.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQB6smJgF0+bChAAOYfNCzKQRjHN10B5AT4p4A=="}' 2021-03-30T05:09:14.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 5b3dde46-4da1-4b9c-b0e1-128c1edd6b8c -i td/ceph-helpers/0/new.json 2021-03-30T05:09:14.496 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:14.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:09:14.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQB6smJgF0+bChAAOYfNCzKQRjHN10B5AT4p4A== --osd-uuid 5b3dde46-4da1-4b9c-b0e1-128c1edd6b8c 2021-03-30T05:09:14.529 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:14.527+0000 7fe1ea51ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:14.531 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:14.529+0000 7fe1ea51ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:14.532 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:14.530+0000 7fe1ea51ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:14.533 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:14.531+0000 7fe1ea51ef40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:14.533 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:14.531+0000 7fe1ea51ef40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:14.533 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:14.531+0000 7fe1ea51ef40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:14.575 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:14.573+0000 7fe1ea51ef40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:09:15.019 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:15.017+0000 7fe1ea51ef40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:09:17.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:09:17.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:09:17.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:09:17.613 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:09:17.613 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:09:17.852 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:09:17.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:09:17.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:09:17.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:17.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:09:17.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:09:17.872 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:17.871+0000 7f8f3b891f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:17.874 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:17.873+0000 7f8f3b891f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:17.876 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:17.874+0000 7f8f3b891f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:18.233 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:09:18.233 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:09:18.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:09:18.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:09:18.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:09:18.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:18.234 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:09:18.235 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:18.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:18.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:18.393 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:18.391+0000 7f8f3b891f40 -1 Falling back to public interface 2021-03-30T05:09:18.601 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:09:19.166 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:19.164+0000 7f8f3b891f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:09:19.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:09:19.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:19.604 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:09:19.604 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:09:19.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:19.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:19.961 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/44234,v1:127.0.0.1:6803/44234] [v2:127.0.0.1:6804/44234,v1:127.0.0.1:6805/44234] exists,up 5b3dde46-4da1-4b9c-b0e1-128c1edd6b8c 2021-03-30T05:09:19.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:09:19.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:09:19.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:09:19.964 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:892: test_activate_osd: get_asok_path osd.0 2021-03-30T05:09:19.964 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:09:19.964 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:09:19.964 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:19.965 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:19.965 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:19.965 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-osd.0.asok 2021-03-30T05:09:19.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:892: test_activate_osd: CEPH_ARGS= 2021-03-30T05:09:19.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:892: test_activate_osd: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-osd.0.asok config get osd_max_backfills 2021-03-30T05:09:20.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:892: test_activate_osd: local 'backfills={"osd_max_backfills":"1"}' 2021-03-30T05:09:20.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:893: test_activate_osd: echo '{"osd_max_backfills":"1"}' 2021-03-30T05:09:20.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:893: test_activate_osd: grep --quiet osd_max_backfills 2021-03-30T05:09:20.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:895: test_activate_osd: kill_daemons td/ceph-helpers TERM osd 2021-03-30T05:09:20.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:20.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:20.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:20.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:20.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:20.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:20.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:897: test_activate_osd: activate_osd td/ceph-helpers 0 --osd-max-backfills 20 2021-03-30T05:09:20.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ceph-helpers 2021-03-30T05:09:20.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2021-03-30T05:09:20.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2021-03-30T05:09:20.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2021-03-30T05:09:20.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:09:20.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:09:20.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:09:20.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:09:20.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:09:20.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:09:20.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:09:20.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2021-03-30T05:09:20.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2021-03-30T05:09:20.170 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:09:20.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2021-03-30T05:09:20.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:20.170 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:20.171 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:20.171 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:20.171 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:20.171 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:20.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:20.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:09:20.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:09:20.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:09:20.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:09:20.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:09:20.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:20.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2021-03-30T05:09:20.173 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+='--osd-max-backfills 20' 2021-03-30T05:09:20.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:09:20.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2021-03-30T05:09:20.174 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:09:20.175 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-max-backfills 20 2021-03-30T05:09:20.176 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ceph-helpers/0/whoami 2021-03-30T05:09:20.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2021-03-30T05:09:20.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2021-03-30T05:09:20.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2021-03-30T05:09:20.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2021-03-30T05:09:20.185 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:20.183+0000 7f7453383f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:20.187 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:20.185+0000 7f7453383f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:20.189 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:20.187+0000 7f7453383f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:20.519 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2021-03-30T05:09:20.520 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:09:20.520 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:09:20.520 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:09:20.520 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:09:20.520 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:20.521 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:09:20.521 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:20.522 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:20.522 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:20.704 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:20.702+0000 7f7453383f40 -1 Falling back to public interface 2021-03-30T05:09:20.875 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/44234,v1:127.0.0.1:6803/44234] [v2:127.0.0.1:6804/44234,v1:127.0.0.1:6805/44234] exists,up 5b3dde46-4da1-4b9c-b0e1-128c1edd6b8c 2021-03-30T05:09:20.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:09:20.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:09:20.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:09:20.878 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:899: test_activate_osd: get_asok_path osd.0 2021-03-30T05:09:20.878 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:09:20.878 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:09:20.878 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:20.878 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:20.879 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:20.879 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-osd.0.asok 2021-03-30T05:09:20.879 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:899: test_activate_osd: CEPH_ARGS= 2021-03-30T05:09:20.879 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:899: test_activate_osd: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-osd.0.asok config get osd_max_backfills 2021-03-30T05:09:20.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:899: test_activate_osd: local 'backfills={"osd_max_backfills":"20"}' 2021-03-30T05:09:20.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:900: test_activate_osd: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2021-03-30T05:09:20.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:902: test_activate_osd: teardown td/ceph-helpers 2021-03-30T05:09:20.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:20.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:20.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:20.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:20.963 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:20.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:20.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:20.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:21.066 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:21.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:21.066 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:21.067 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:21.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:21.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:21.068 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:21.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:21.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:21.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:21.070 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:21.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:21.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:21.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:21.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:21.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:21.074 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:21.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:21.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:21.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:21.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:21.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_destroy_osd td/ceph-helpers 2021-03-30T05:09:21.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:794: test_destroy_osd: local dir=td/ceph-helpers 2021-03-30T05:09:21.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:796: test_destroy_osd: setup td/ceph-helpers 2021-03-30T05:09:21.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:21.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:21.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:21.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:21.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:21.078 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:21.078 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:21.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:21.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:21.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:21.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:21.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:21.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:21.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:21.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:21.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:21.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:21.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:21.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:21.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:21.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:21.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:21.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:21.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:21.084 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:21.085 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:21.085 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:21.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:21.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:21.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:21.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:21.087 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:21.088 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:21.088 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:21.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:21.088 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:21.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:21.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:21.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:21.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:797: test_destroy_osd: run_mon td/ceph-helpers a 2021-03-30T05:09:21.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:21.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:21.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:21.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:21.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:21.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2021-03-30T05:09:21.350 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:09:21.350 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:21.350 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:21.351 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:21.351 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:21.351 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:21.352 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:21.352 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:09:21.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:09:21.507 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:09:21.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:21.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:21.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:09:21.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:09:21.509 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:21.509 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:21.509 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:21.509 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:21.509 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:21.510 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:21.510 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:21.510 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:21.510 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:09:21.595 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:09:21.595 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:21.595 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:21.596 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:09:21.596 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:09:21.596 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:21.596 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:21.597 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:21.597 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:21.597 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:21.597 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:21.597 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:21.598 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:21.598 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:09:21.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:798: test_destroy_osd: run_mgr td/ceph-helpers x 2021-03-30T05:09:21.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:09:21.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:09:21.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:09:21.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:09:21.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:09:21.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:09:22.553 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:09:22.554 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:22.554 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:22.554 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:22.554 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:22.555 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:22.555 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:22.555 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:22.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:22.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:799: test_destroy_osd: run_osd td/ceph-helpers 0 2021-03-30T05:09:22.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:09:22.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:09:22.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:09:22.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:09:22.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:09:22.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:09:22.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:09:22.583 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:09:22.583 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:09:22.583 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:09:22.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:09:22.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:09:22.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:09:22.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:09:22.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:09:22.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:22.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:22.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:22.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:22.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:22.587 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:22.587 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:22.587 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:09:22.587 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:09:22.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:09:22.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:09:22.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:09:22.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:09:22.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:09:22.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:22.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:09:22.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:09:22.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:09:22.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:09:22.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=9277d1f6-858a-4e7a-9f9e-59b5a6ee963e 2021-03-30T05:09:22.590 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 9277d1f6-858a-4e7a-9f9e-59b5a6ee963e 2021-03-30T05:09:22.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 9277d1f6-858a-4e7a-9f9e-59b5a6ee963e' 2021-03-30T05:09:22.591 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:09:22.593 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCCsmJgWBtRIxAAedKU8ftl7v7/u2jk3/4zKw== 2021-03-30T05:09:22.593 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCCsmJgWBtRIxAAedKU8ftl7v7/u2jk3/4zKw=="}' 2021-03-30T05:09:22.593 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 9277d1f6-858a-4e7a-9f9e-59b5a6ee963e -i td/ceph-helpers/0/new.json 2021-03-30T05:09:22.919 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:22.928 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:09:22.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCCsmJgWBtRIxAAedKU8ftl7v7/u2jk3/4zKw== --osd-uuid 9277d1f6-858a-4e7a-9f9e-59b5a6ee963e 2021-03-30T05:09:22.952 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:22.951+0000 7f70dfd2df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:22.954 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:22.953+0000 7f70dfd2df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:22.955 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:22.954+0000 7f70dfd2df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:22.955 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:22.954+0000 7f70dfd2df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:22.956 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:22.955+0000 7f70dfd2df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:22.956 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:22.955+0000 7f70dfd2df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:22.997 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:22.996+0000 7f70dfd2df40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:09:23.457 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:23.456+0000 7f70dfd2df40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:09:26.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:09:26.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:09:26.076 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:09:26.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:09:26.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:09:26.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:09:26.324 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:09:26.324 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:26.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:09:26.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:09:26.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:09:26.343 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:26.343+0000 7f85f9158f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:26.345 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:26.345+0000 7f85f9158f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:26.346 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:26.345+0000 7f85f9158f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:26.700 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:09:26.701 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:09:26.701 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:09:26.701 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:09:26.701 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:09:26.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:26.702 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:26.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:09:26.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:26.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:26.863 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:26.862+0000 7f85f9158f40 -1 Falling back to public interface 2021-03-30T05:09:27.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:09:27.639 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:27.638+0000 7f85f9158f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:09:28.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:09:28.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:28.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:09:28.059 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:09:28.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:28.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:28.419 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/44967,v1:127.0.0.1:6803/44967] [v2:127.0.0.1:6804/44967,v1:127.0.0.1:6805/44967] exists,up 9277d1f6-858a-4e7a-9f9e-59b5a6ee963e 2021-03-30T05:09:28.420 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:09:28.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:09:28.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:09:28.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:800: test_destroy_osd: destroy_osd td/ceph-helpers 0 2021-03-30T05:09:28.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:782: destroy_osd: local dir=td/ceph-helpers 2021-03-30T05:09:28.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:783: destroy_osd: local id=0 2021-03-30T05:09:28.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:785: destroy_osd: ceph osd out osd.0 2021-03-30T05:09:28.920 INFO:tasks.workunit.client.0.smithi197.stderr:osd.0 is already out. 2021-03-30T05:09:28.928 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:786: destroy_osd: kill_daemons td/ceph-helpers TERM osd.0 2021-03-30T05:09:28.929 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:28.929 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:28.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:28.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:28.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:29.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:29.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:787: destroy_osd: ceph osd down osd.0 2021-03-30T05:09:29.529 INFO:tasks.workunit.client.0.smithi197.stderr:osd.0 is already down. 2021-03-30T05:09:29.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:788: destroy_osd: ceph osd purge osd.0 --yes-i-really-mean-it 2021-03-30T05:09:29.951 INFO:tasks.workunit.client.0.smithi197.stderr:osd.0 does not exist 2021-03-30T05:09:29.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:789: destroy_osd: teardown td/ceph-helpers/0 2021-03-30T05:09:29.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers/0 2021-03-30T05:09:29.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:29.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers/0 KILL 2021-03-30T05:09:29.961 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:29.961 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:29.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:29.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:29.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:29.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:29.963 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:29.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:29.963 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:29.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:29.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:29.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:29.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:29.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:29.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:29.966 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:29.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:29.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:29.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers/0 2021-03-30T05:09:29.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:29.969 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:29.969 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:29.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:29.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:29.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:29.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:790: destroy_osd: rm -fr td/ceph-helpers/0 2021-03-30T05:09:29.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:801: test_destroy_osd: ceph osd dump 2021-03-30T05:09:29.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:801: test_destroy_osd: grep 'osd. ' 2021-03-30T05:09:30.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:802: test_destroy_osd: teardown td/ceph-helpers 2021-03-30T05:09:30.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:30.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:30.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:30.320 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:30.320 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:30.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:30.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:30.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:30.424 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:30.424 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:30.425 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:30.425 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:30.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:30.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:30.426 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:30.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:30.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:30.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:30.428 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:30.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:30.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:30.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:30.431 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:30.431 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:30.432 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:30.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:30.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:30.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:30.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:30.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_display_logs td/ceph-helpers 2021-03-30T05:09:30.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1972: test_display_logs: local dir=td/ceph-helpers 2021-03-30T05:09:30.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1974: test_display_logs: setup td/ceph-helpers 2021-03-30T05:09:30.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:30.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:30.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:30.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:30.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:30.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:30.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:30.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:30.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:30.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:30.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:30.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:30.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:30.439 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:30.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:30.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:30.440 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:30.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:30.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:30.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:30.441 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:30.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:30.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:30.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:30.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:30.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:30.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:30.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:30.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:30.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:30.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:30.446 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:30.447 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:30.447 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:30.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:30.447 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:30.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:30.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:30.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:30.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1975: test_display_logs: run_mon td/ceph-helpers a 2021-03-30T05:09:30.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:30.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:30.449 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:30.449 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:30.449 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:30.449 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2021-03-30T05:09:30.698 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:09:30.698 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:30.699 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:30.699 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:30.699 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:30.699 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:30.700 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:30.700 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:09:30.888 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:09:30.889 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:09:30.890 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:30.890 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:30.890 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:09:30.890 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:09:30.891 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:30.891 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:30.891 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:30.891 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:30.891 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:30.891 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:30.892 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:30.892 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:30.892 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:09:30.977 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:09:30.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:30.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:30.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:09:30.978 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:09:30.979 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:30.979 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:30.979 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:30.979 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:30.980 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:30.980 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:30.980 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:30.980 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:30.981 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:09:31.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1976: test_display_logs: kill_daemons td/ceph-helpers 2021-03-30T05:09:31.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:31.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:31.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:31.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:31.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:32.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:32.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1977: test_display_logs: display_logs td/ceph-helpers 2021-03-30T05:09:32.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1962: display_logs: local dir=td/ceph-helpers 2021-03-30T05:09:32.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1964: display_logs: find td/ceph-helpers -maxdepth 1 -name '*.log' 2021-03-30T05:09:32.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1965: display_logs: read file 2021-03-30T05:09:32.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1966: display_logs: echo '======================= td/ceph-helpers/mon.a.log' 2021-03-30T05:09:32.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1967: display_logs: cat td/ceph-helpers/mon.a.log 2021-03-30T05:09:32.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1965: display_logs: read file 2021-03-30T05:09:32.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1978: test_display_logs: grep --quiet mon.a.log td/ceph-helpers/log.out 2021-03-30T05:09:32.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1979: test_display_logs: teardown td/ceph-helpers 2021-03-30T05:09:32.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:32.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:32.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:32.376 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:32.376 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:32.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:32.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:32.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:32.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:32.377 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:32.378 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:32.378 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:32.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:32.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:32.380 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:32.381 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:32.381 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:32.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:32.382 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:32.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:32.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:32.384 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:32.385 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:32.385 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:32.386 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:32.386 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:32.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:32.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:32.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:32.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_erasure_code_plugin_exists td/ceph-helpers 2021-03-30T05:09:32.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1943: test_erasure_code_plugin_exists: local dir=td/ceph-helpers 2021-03-30T05:09:32.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1945: test_erasure_code_plugin_exists: setup td/ceph-helpers 2021-03-30T05:09:32.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:32.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:32.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:32.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:32.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:32.390 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:32.391 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:32.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:32.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:32.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:32.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:32.393 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:32.393 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:32.393 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:32.393 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:32.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:32.394 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:32.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:32.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:32.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:32.395 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:32.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:32.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:32.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:32.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:32.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:32.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:32.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:32.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:32.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:32.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:32.399 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:32.400 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:32.400 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:32.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:32.402 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:32.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:32.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:32.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:32.403 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1946: test_erasure_code_plugin_exists: run_mon td/ceph-helpers a 2021-03-30T05:09:32.403 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:32.403 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:32.403 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:32.403 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:32.404 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:32.404 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2021-03-30T05:09:32.676 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:09:32.677 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:32.677 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:32.677 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:32.678 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:32.678 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:32.678 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:32.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:09:32.869 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:09:32.870 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:09:32.871 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:32.871 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:32.871 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:09:32.871 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:09:32.872 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:32.872 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:32.872 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:32.872 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:32.873 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:32.873 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:32.873 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:32.874 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:32.874 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:09:32.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:09:32.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:32.969 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:32.969 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:09:32.969 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:09:32.969 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:32.970 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:32.970 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:32.970 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:32.970 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:32.970 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:32.971 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:32.971 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:32.971 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:09:33.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1947: test_erasure_code_plugin_exists: run_mgr td/ceph-helpers x 2021-03-30T05:09:33.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:09:33.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:09:33.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:09:33.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:09:33.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:09:33.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:09:33.957 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:09:33.957 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:33.958 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:33.958 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:33.958 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:33.958 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:33.959 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:33.959 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:33.959 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:33.979 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1948: test_erasure_code_plugin_exists: erasure_code_plugin_exists jerasure 2021-03-30T05:09:33.979 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1921: erasure_code_plugin_exists: local plugin=jerasure 2021-03-30T05:09:33.979 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1922: erasure_code_plugin_exists: local status 2021-03-30T05:09:33.979 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: erasure_code_plugin_exists: local grepstr 2021-03-30T05:09:33.980 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1924: erasure_code_plugin_exists: local s 2021-03-30T05:09:33.980 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: erasure_code_plugin_exists: case `uname` in 2021-03-30T05:09:33.980 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: erasure_code_plugin_exists: uname 2021-03-30T05:09:33.981 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: erasure_code_plugin_exists: grepstr='jerasure.*No such file' 2021-03-30T05:09:33.981 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1930: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=jerasure 2021-03-30T05:09:34.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1930: erasure_code_plugin_exists: s= 2021-03-30T05:09:34.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1931: erasure_code_plugin_exists: local status=0 2021-03-30T05:09:34.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: erasure_code_plugin_exists: '[' 0 -eq 0 ']' 2021-03-30T05:09:34.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1933: erasure_code_plugin_exists: ceph osd erasure-code-profile rm TESTPROFILE 2021-03-30T05:09:34.702 INFO:tasks.workunit.client.0.smithi197.stderr:erasure-code-profile TESTPROFILE does not exist 2021-03-30T05:09:34.711 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1939: erasure_code_plugin_exists: return 0 2021-03-30T05:09:34.711 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1949: test_erasure_code_plugin_exists: erasure_code_plugin_exists FAKE 2021-03-30T05:09:34.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1921: erasure_code_plugin_exists: local plugin=FAKE 2021-03-30T05:09:34.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1922: erasure_code_plugin_exists: local status 2021-03-30T05:09:34.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: erasure_code_plugin_exists: local grepstr 2021-03-30T05:09:34.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1924: erasure_code_plugin_exists: local s 2021-03-30T05:09:34.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: erasure_code_plugin_exists: case `uname` in 2021-03-30T05:09:34.713 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: erasure_code_plugin_exists: uname 2021-03-30T05:09:34.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: erasure_code_plugin_exists: grepstr='FAKE.*No such file' 2021-03-30T05:09:34.714 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1930: erasure_code_plugin_exists: ceph osd erasure-code-profile set TESTPROFILE plugin=FAKE 2021-03-30T05:09:34.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1930: erasure_code_plugin_exists: s='Error EIO: load dlopen(/usr/lib64/ceph/erasure-code/libec_FAKE.so): /usr/lib64/ceph/erasure-code/libec_FAKE.so: cannot open shared object file: No such file or directory' 2021-03-30T05:09:34.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1931: erasure_code_plugin_exists: local status=5 2021-03-30T05:09:34.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: erasure_code_plugin_exists: '[' 5 -eq 0 ']' 2021-03-30T05:09:34.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: erasure_code_plugin_exists: echo Error EIO: load 'dlopen(/usr/lib64/ceph/erasure-code/libec_FAKE.so):' /usr/lib64/ceph/erasure-code/libec_FAKE.so: cannot open shared object file: No such file or directory 2021-03-30T05:09:34.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: erasure_code_plugin_exists: grep --quiet 'FAKE.*No such file' 2021-03-30T05:09:34.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1939: erasure_code_plugin_exists: return 5 2021-03-30T05:09:34.926 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1950: test_erasure_code_plugin_exists: teardown td/ceph-helpers 2021-03-30T05:09:34.926 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:34.926 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:34.926 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:34.926 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:34.927 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:34.927 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:34.927 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:34.927 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:35.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:35.029 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:35.030 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:35.030 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:35.031 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:35.031 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:35.031 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:35.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:35.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:35.033 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:35.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:35.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:35.036 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:35.036 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.036 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:35.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:35.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:35.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:35.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_expect_failure td/ceph-helpers 2021-03-30T05:09:35.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1853: test_expect_failure: local dir=td/ceph-helpers 2021-03-30T05:09:35.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1855: test_expect_failure: setup td/ceph-helpers 2021-03-30T05:09:35.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:35.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:35.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:35.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:35.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:35.040 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:35.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:35.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:35.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:35.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:35.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:35.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:35.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:35.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:35.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:35.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:35.044 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:35.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:35.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:35.045 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:35.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:35.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:35.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:35.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:35.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:35.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:35.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:35.051 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:35.051 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.051 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:35.052 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:35.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:35.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:35.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:35.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1856: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo FAIL ; exit 1' 2021-03-30T05:09:35.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/ceph-helpers 2021-03-30T05:09:35.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2021-03-30T05:09:35.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local expected=FAIL 2021-03-30T05:09:35.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2021-03-30T05:09:35.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2021-03-30T05:09:35.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: bash -c 'echo FAIL ; exit 1' 2021-03-30T05:09:35.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2021-03-30T05:09:35.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2021-03-30T05:09:35.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet FAIL td/ceph-helpers/out 2021-03-30T05:09:35.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1848: expect_failure: return 0 2021-03-30T05:09:35.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1858: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo FAIL ; exit 0' 2021-03-30T05:09:35.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/ceph-helpers 2021-03-30T05:09:35.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2021-03-30T05:09:35.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local expected=FAIL 2021-03-30T05:09:35.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2021-03-30T05:09:35.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2021-03-30T05:09:35.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: bash -c 'echo FAIL ; exit 0' 2021-03-30T05:09:35.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1839: expect_failure: success=true 2021-03-30T05:09:35.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: true 2021-03-30T05:09:35.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1845: expect_failure: cat td/ceph-helpers/out 2021-03-30T05:09:35.060 INFO:tasks.workunit.client.0.smithi197.stderr:FAIL 2021-03-30T05:09:35.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1846: expect_failure: return 1 2021-03-30T05:09:35.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1859: test_expect_failure: grep --quiet FAIL td/ceph-helpers/out 2021-03-30T05:09:35.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1861: test_expect_failure: expect_failure td/ceph-helpers FAIL bash -c 'echo UNEXPECTED ; exit 1' 2021-03-30T05:09:35.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1832: expect_failure: local dir=td/ceph-helpers 2021-03-30T05:09:35.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1833: expect_failure: shift 2021-03-30T05:09:35.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1834: expect_failure: local expected=FAIL 2021-03-30T05:09:35.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1835: expect_failure: shift 2021-03-30T05:09:35.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1836: expect_failure: local success 2021-03-30T05:09:35.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1838: expect_failure: bash -c 'echo UNEXPECTED ; exit 1' 2021-03-30T05:09:35.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1841: expect_failure: success=false 2021-03-30T05:09:35.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: false 2021-03-30T05:09:35.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1844: expect_failure: grep --quiet FAIL td/ceph-helpers/out 2021-03-30T05:09:35.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1845: expect_failure: cat td/ceph-helpers/out 2021-03-30T05:09:35.063 INFO:tasks.workunit.client.0.smithi197.stderr:UNEXPECTED 2021-03-30T05:09:35.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1846: expect_failure: return 1 2021-03-30T05:09:35.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1862: test_expect_failure: grep --quiet FAIL td/ceph-helpers/out 2021-03-30T05:09:35.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1863: test_expect_failure: teardown td/ceph-helpers 2021-03-30T05:09:35.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:35.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:35.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:35.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:35.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:35.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:35.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:35.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:35.066 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:35.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:35.066 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:35.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:35.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:35.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:35.070 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:35.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:35.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:35.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:35.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:35.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:35.072 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:35.072 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.072 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:35.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:35.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:35.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:35.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_flush_pg_stats td/ceph-helpers 2021-03-30T05:09:35.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2095: test_flush_pg_stats: local dir=td/ceph-helpers 2021-03-30T05:09:35.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2097: test_flush_pg_stats: setup td/ceph-helpers 2021-03-30T05:09:35.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:35.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:35.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:35.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:35.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:35.075 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:35.075 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:35.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:35.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:35.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:35.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:35.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:35.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:35.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:35.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:35.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:35.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:35.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:35.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:35.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:35.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:35.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:35.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:35.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:35.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:35.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:35.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:35.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:35.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:35.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:35.084 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:35.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:35.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:35.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:35.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2098: test_flush_pg_stats: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:09:35.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:35.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:35.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:35.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:35.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:35.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:09:35.365 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:09:35.365 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:35.366 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:35.366 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:35.366 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.366 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.366 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:35.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:09:35.524 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:09:35.526 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:09:35.526 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:35.527 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:35.527 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:09:35.527 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:09:35.527 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:35.528 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:35.528 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:35.528 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:35.528 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.528 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.529 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:35.529 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:35.529 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:09:35.613 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:09:35.613 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:35.613 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:35.614 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:09:35.614 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:09:35.614 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:35.614 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:35.614 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:35.615 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:35.615 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:35.615 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:35.615 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:35.615 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:35.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:09:35.698 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2099: test_flush_pg_stats: run_mgr td/ceph-helpers x 2021-03-30T05:09:35.698 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:09:35.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:09:35.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:09:35.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:09:35.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:09:35.700 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:09:36.571 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:09:36.572 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:36.572 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:36.572 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:36.572 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:36.573 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:36.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:36.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:36.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:36.596 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2100: test_flush_pg_stats: run_osd td/ceph-helpers 0 2021-03-30T05:09:36.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:09:36.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:09:36.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:09:36.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:09:36.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:09:36.598 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:09:36.598 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:09:36.598 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:09:36.598 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:09:36.599 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:09:36.599 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:09:36.599 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:09:36.599 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:09:36.599 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:09:36.600 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:09:36.600 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:36.600 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:36.600 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:36.601 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:36.601 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:36.601 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:36.601 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:36.601 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:09:36.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:09:36.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:09:36.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:09:36.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:09:36.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:09:36.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:09:36.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:36.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:09:36.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:09:36.604 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:09:36.604 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:09:36.604 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=90e04559-15b7-45bd-ad12-ba3c1fd326ff 2021-03-30T05:09:36.604 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 90e04559-15b7-45bd-ad12-ba3c1fd326ff 2021-03-30T05:09:36.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 90e04559-15b7-45bd-ad12-ba3c1fd326ff' 2021-03-30T05:09:36.605 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:09:36.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCQsmJgXi9aJBAAMMq9pnWd+36XdrL9scNI5Q== 2021-03-30T05:09:36.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCQsmJgXi9aJBAAMMq9pnWd+36XdrL9scNI5Q=="}' 2021-03-30T05:09:36.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 90e04559-15b7-45bd-ad12-ba3c1fd326ff -i td/ceph-helpers/0/new.json 2021-03-30T05:09:36.937 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:36.947 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:09:36.948 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCQsmJgXi9aJBAAMMq9pnWd+36XdrL9scNI5Q== --osd-uuid 90e04559-15b7-45bd-ad12-ba3c1fd326ff 2021-03-30T05:09:36.970 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:36.969+0000 7fca5d35bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:36.971 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:36.971+0000 7fca5d35bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:36.973 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:36.972+0000 7fca5d35bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:36.973 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:36.973+0000 7fca5d35bf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:36.974 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:36.973+0000 7fca5d35bf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:36.974 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:36.973+0000 7fca5d35bf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:37.028 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:37.028+0000 7fca5d35bf40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:09:37.401 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:37.400+0000 7fca5d35bf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:09:40.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:09:40.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:09:40.153 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:09:40.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:09:40.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:09:40.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:09:40.623 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:09:40.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:40.624 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:09:40.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:09:40.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:09:40.643 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:40.642+0000 7fbd6c14ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:40.645 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:40.644+0000 7fbd6c14ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:40.646 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:40.646+0000 7fbd6c14ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:40.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:09:40.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:09:40.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:09:40.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:09:40.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:09:40.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:40.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:09:40.999 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:40.999 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:41.000 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:41.162 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:41.162+0000 7fbd6c14ff40 -1 Falling back to public interface 2021-03-30T05:09:41.356 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:09:41.849 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:41.849+0000 7fbd6c14ff40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:09:42.357 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:09:42.358 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:42.358 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:09:42.359 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:09:42.359 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:42.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:42.741 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/46157,v1:127.0.0.1:6803/46157] [v2:127.0.0.1:6804/46157,v1:127.0.0.1:6805/46157] exists,up 90e04559-15b7-45bd-ad12-ba3c1fd326ff 2021-03-30T05:09:42.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:09:42.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:09:42.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:09:42.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2101: test_flush_pg_stats: create_rbd_pool 2021-03-30T05:09:42.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:09:43.177 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:09:43.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:09:43.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:09:43.686 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:09:43.693 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:09:44.695 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:09:45.709 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2102: test_flush_pg_stats: rados -p rbd put obj /etc/group 2021-03-30T05:09:45.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2103: test_flush_pg_stats: flush_pg_stats 2021-03-30T05:09:45.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:09:45.800 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:09:46.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:09:46.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:09:46.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:09:46.160 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:09:46.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:09:46.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:09:46.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:09:46.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:09:46.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:09:46.283 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:09:46.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:09:46.284 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:09:46.284 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:09:46.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:09:46.285 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:09:46.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:09:46.286 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:09:46.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:09:46.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:09:47.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:09:47.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:09:47.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:09:47.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:09:48.999 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:09:48.999 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:09:49.356 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:09:49.356 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2104: test_flush_pg_stats: local 'jq_filter=.pools | .[] | select(.name == "rbd") | .stats' 2021-03-30T05:09:49.357 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2105: test_flush_pg_stats: ceph df detail --format=json 2021-03-30T05:09:49.357 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2105: test_flush_pg_stats: jq '.pools | .[] | select(.name == "rbd") | .stats.stored' 2021-03-30T05:09:49.816 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2105: test_flush_pg_stats: stored=4244 2021-03-30T05:09:49.816 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2106: test_flush_pg_stats: ceph df detail --format=json 2021-03-30T05:09:49.817 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2106: test_flush_pg_stats: jq '.pools | .[] | select(.name == "rbd") | .stats.stored_raw' 2021-03-30T05:09:50.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2106: test_flush_pg_stats: stored_raw=4244 2021-03-30T05:09:50.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2107: test_flush_pg_stats: test 4244 -gt 0 2021-03-30T05:09:50.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2108: test_flush_pg_stats: test 4244 == 4244 2021-03-30T05:09:50.283 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2109: test_flush_pg_stats: teardown td/ceph-helpers 2021-03-30T05:09:50.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:50.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:50.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:50.284 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:50.285 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:50.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:50.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:50.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:50.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:50.388 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:50.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:50.389 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:50.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:50.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:50.390 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:50.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:50.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:50.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:50.392 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:50.393 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:50.393 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:50.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:50.396 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:50.396 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:50.396 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:50.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:50.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:50.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:50.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:50.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_config td/ceph-helpers 2021-03-30T05:09:50.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1074: test_get_config: local dir=td/ceph-helpers 2021-03-30T05:09:50.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1077: test_get_config: setup td/ceph-helpers 2021-03-30T05:09:50.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:50.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:50.401 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:50.401 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:50.401 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:50.401 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:50.401 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:50.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:50.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:50.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:50.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:50.403 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:50.404 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:50.405 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:50.405 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:50.405 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:50.405 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:50.405 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:50.406 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:50.406 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:50.406 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:50.406 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:50.406 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:50.407 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:50.409 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:50.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:50.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:50.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:50.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:50.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:50.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:50.411 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:50.411 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:50.411 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:50.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:50.412 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:50.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:50.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:50.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:50.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1078: test_get_config: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:09:50.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:50.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:50.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:50.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:50.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:50.414 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:09:50.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:09:50.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:50.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:50.707 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:50.707 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:50.708 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:50.708 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:50.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:09:50.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:09:50.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:09:50.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:50.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:50.887 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:09:50.887 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:09:50.887 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:50.887 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:50.887 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:50.888 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:50.888 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:50.888 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:50.888 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:50.889 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:50.889 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:09:50.973 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:09:50.973 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:50.974 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:50.974 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:09:50.974 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:09:50.974 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:50.975 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:50.975 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:50.975 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:50.975 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:50.975 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:50.976 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:50.976 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:50.976 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:09:51.060 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1079: test_get_config: get_config mon a osd_pool_default_size 2021-03-30T05:09:51.060 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:51.060 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:51.061 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=osd_pool_default_size 2021-03-30T05:09:51.061 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .osd_pool_default_size 2021-03-30T05:09:51.061 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:51.061 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:51.062 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:51.062 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:51.062 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:51.062 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:51.062 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:51.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:51.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get osd_pool_default_size 2021-03-30T05:09:51.147 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1079: test_get_config: test 1 = 1 2021-03-30T05:09:51.148 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1080: test_get_config: run_mgr td/ceph-helpers x 2021-03-30T05:09:51.148 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:09:51.148 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:09:51.148 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:09:51.149 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:09:51.149 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:09:51.149 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:09:52.007 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:09:52.008 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:52.008 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:52.008 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:52.009 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:52.009 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:52.010 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:52.010 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:52.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:52.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1081: test_get_config: run_osd td/ceph-helpers 0 --osd_max_scrubs=3 2021-03-30T05:09:52.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:09:52.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:09:52.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:09:52.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:09:52.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:09:52.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:09:52.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:09:52.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:09:52.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:09:52.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:09:52.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:09:52.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:09:52.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:09:52.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:09:52.040 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:09:52.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:52.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:52.042 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:52.042 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:52.042 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:52.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:52.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:52.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:09:52.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:09:52.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:09:52.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:09:52.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:09:52.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:09:52.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:09:52.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:09:52.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:09:52.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=--osd_max_scrubs=3 2021-03-30T05:09:52.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:09:52.048 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:09:52.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=297b1257-91a2-4911-aee2-300abc73c41a 2021-03-30T05:09:52.049 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 297b1257-91a2-4911-aee2-300abc73c41a 2021-03-30T05:09:52.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 297b1257-91a2-4911-aee2-300abc73c41a' 2021-03-30T05:09:52.051 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:09:52.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCgsmJg2pyrAhAANZ4KvoC3gl/d7bs726iEEg== 2021-03-30T05:09:52.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCgsmJg2pyrAhAANZ4KvoC3gl/d7bs726iEEg=="}' 2021-03-30T05:09:52.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 297b1257-91a2-4911-aee2-300abc73c41a -i td/ceph-helpers/0/new.json 2021-03-30T05:09:52.365 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:52.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:09:52.375 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd_max_scrubs=3 --mkfs --key AQCgsmJg2pyrAhAANZ4KvoC3gl/d7bs726iEEg== --osd-uuid 297b1257-91a2-4911-aee2-300abc73c41a 2021-03-30T05:09:52.397 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.396+0000 7fbc207ccf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:52.399 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.398+0000 7fbc207ccf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:52.400 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.399+0000 7fbc207ccf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:52.401 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.399+0000 7fbc207ccf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:52.402 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.399+0000 7fbc207ccf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:52.402 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.399+0000 7fbc207ccf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:09:52.446 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.444+0000 7fbc207ccf40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:09:52.902 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:52.900+0000 7fbc207ccf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:09:55.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:09:55.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:09:55.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:09:55.496 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:09:55.497 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:09:55.717 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:09:55.718 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:09:55.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd_max_scrubs=3 2021-03-30T05:09:55.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:09:55.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:09:55.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:09:55.738 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:55.737+0000 7f89064b6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:55.740 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:55.738+0000 7f89064b6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:55.741 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:55.740+0000 7f89064b6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:09:56.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:09:56.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:09:56.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:09:56.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:09:56.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:09:56.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:56.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:09:56.072 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:09:56.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:56.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:56.260 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:56.258+0000 7f89064b6f40 -1 Falling back to public interface 2021-03-30T05:09:56.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:09:57.000 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:09:56.998+0000 7f89064b6f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:09:57.457 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:09:57.457 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:09:57.457 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:09:57.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:09:57.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:09:57.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:09:57.821 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/47076,v1:127.0.0.1:6803/47076] [v2:127.0.0.1:6804/47076,v1:127.0.0.1:6805/47076] exists,up 297b1257-91a2-4911-aee2-300abc73c41a 2021-03-30T05:09:57.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:09:57.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:09:57.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:09:57.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1082: test_get_config: get_config osd 0 osd_max_scrubs 2021-03-30T05:09:57.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=osd 2021-03-30T05:09:57.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=0 2021-03-30T05:09:57.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=osd_max_scrubs 2021-03-30T05:09:57.826 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .osd_max_scrubs 2021-03-30T05:09:57.826 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path osd.0 2021-03-30T05:09:57.826 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:09:57.826 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:09:57.827 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:57.827 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:57.827 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:57.827 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-osd.0.asok 2021-03-30T05:09:57.828 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:57.828 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-osd.0.asok config get osd_max_scrubs 2021-03-30T05:09:57.917 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1082: test_get_config: test 3 = 3 2021-03-30T05:09:57.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1083: test_get_config: teardown td/ceph-helpers 2021-03-30T05:09:57.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:57.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:57.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:57.919 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:57.919 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:57.919 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:57.919 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:57.920 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:58.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:58.023 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:58.024 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:58.024 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:58.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:58.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:58.025 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:58.026 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:58.027 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:58.027 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:58.027 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:58.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:58.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:58.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:58.030 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:58.031 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:58.031 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:58.031 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:58.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:58.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:58.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:58.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_is_making_recovery_progress td/ceph-helpers 2021-03-30T05:09:58.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1282: test_get_is_making_recovery_progress: local dir=td/ceph-helpers 2021-03-30T05:09:58.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1284: test_get_is_making_recovery_progress: setup td/ceph-helpers 2021-03-30T05:09:58.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:58.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:58.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:58.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:58.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:58.036 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:58.036 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:58.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:58.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:58.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:58.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:58.037 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:58.039 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:58.040 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:58.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:58.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:58.040 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:58.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:58.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:58.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:58.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:58.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:58.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:58.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:58.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:58.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:58.043 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:58.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:58.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:58.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:58.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:58.046 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:58.046 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:58.046 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:58.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:58.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:58.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:58.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:58.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:58.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1285: test_get_is_making_recovery_progress: run_mon td/ceph-helpers a 2021-03-30T05:09:58.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:58.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:58.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:58.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:58.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:58.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2021-03-30T05:09:58.337 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:09:58.338 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:58.338 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:58.338 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:58.338 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:58.339 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:58.339 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:58.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:09:58.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:09:58.498 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:09:58.498 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:58.499 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:58.499 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:09:58.499 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:09:58.499 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:58.499 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:58.500 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:58.500 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:58.500 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:58.500 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:58.501 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:58.501 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:58.501 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:09:58.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:09:58.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:09:58.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:09:58.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:09:58.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:09:58.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:09:58.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:09:58.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:09:58.586 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:09:58.587 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:58.587 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:58.587 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:09:58.587 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:09:58.588 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:09:58.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1286: test_get_is_making_recovery_progress: run_mgr td/ceph-helpers x 2021-03-30T05:09:58.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:09:58.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:09:58.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:09:58.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:09:58.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:09:58.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:09:59.578 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:09:59.579 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:09:59.579 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:09:59.579 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:09:59.580 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:59.580 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:59.581 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:09:59.581 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:59.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:09:59.599 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1287: test_get_is_making_recovery_progress: get_is_making_recovery_progress 2021-03-30T05:09:59.600 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:09:59.600 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:09:59.600 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:09:59.600 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:09:59.600 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:09:59.601 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:09:59.840 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:09:59.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:09:59.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: test_get_is_making_recovery_progress: teardown td/ceph-helpers 2021-03-30T05:09:59.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:59.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:59.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:59.842 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:59.842 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:59.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:59.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:59.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:59.945 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:59.945 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:59.946 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:59.946 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:59.947 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:59.947 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:59.947 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:59.948 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:59.949 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:59.949 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:59.949 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:59.950 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:59.950 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:59.951 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:59.952 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:59.952 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:59.952 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:59.952 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:59.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:59.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:59.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:09:59.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_last_scrub_stamp td/ceph-helpers 2021-03-30T05:09:59.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1471: test_get_last_scrub_stamp: local dir=td/ceph-helpers 2021-03-30T05:09:59.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1473: test_get_last_scrub_stamp: setup td/ceph-helpers 2021-03-30T05:09:59.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:09:59.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:09:59.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:09:59.957 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:09:59.957 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:09:59.957 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:09:59.957 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:09:59.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:09:59.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:09:59.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:09:59.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:09:59.958 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:09:59.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:09:59.960 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:09:59.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:09:59.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:09:59.961 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:09:59.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:59.961 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:09:59.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:09:59.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:09:59.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:09:59.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:09:59.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:09:59.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:09:59.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:59.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:59.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:09:59.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:09:59.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:09:59.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:09:59.966 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:09:59.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:09:59.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:09:59.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:09:59.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:09:59.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:09:59.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:09:59.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:09:59.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1474: test_get_last_scrub_stamp: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:09:59.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:09:59.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:09:59.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:09:59.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:09:59.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:09:59.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:10:00.187 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:10:00.188 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:00.188 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:00.188 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:00.188 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:00.189 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:00.189 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:00.189 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:10:00.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:10:00.329 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:10:00.329 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:00.330 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:00.330 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:10:00.330 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:10:00.330 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:00.330 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:00.331 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:00.331 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:00.331 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:00.331 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:00.332 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:00.332 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:00.332 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:10:00.416 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:10:00.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:00.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:00.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:10:00.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:10:00.418 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:00.418 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:00.418 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:00.418 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:00.418 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:00.419 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:00.419 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:00.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:00.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:10:00.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1475: test_get_last_scrub_stamp: run_mgr td/ceph-helpers x 2021-03-30T05:10:00.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:10:00.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:10:00.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:10:00.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:10:00.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:10:00.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:10:01.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:10:01.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:01.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:01.418 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:01.418 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:01.418 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:01.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:01.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:01.419 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:01.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1476: test_get_last_scrub_stamp: run_osd td/ceph-helpers 0 2021-03-30T05:10:01.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:10:01.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:10:01.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:10:01.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:10:01.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:10:01.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:10:01.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:10:01.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:10:01.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:10:01.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:10:01.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:10:01.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:10:01.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:10:01.445 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:10:01.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:10:01.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:01.445 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:01.446 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:01.446 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:01.446 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:01.446 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:01.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:01.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:10:01.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:10:01.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:10:01.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:10:01.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:10:01.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:10:01.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:10:01.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:01.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:10:01.449 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:10:01.449 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:10:01.449 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:10:01.450 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=5ef98954-90ca-48ef-9f03-01ecccb04b01 2021-03-30T05:10:01.450 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 5ef98954-90ca-48ef-9f03-01ecccb04b01 2021-03-30T05:10:01.451 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 5ef98954-90ca-48ef-9f03-01ecccb04b01' 2021-03-30T05:10:01.451 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:10:01.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCpsmJg8aInGxAAyG9KSK5mPyHc6+hAwD6sag== 2021-03-30T05:10:01.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCpsmJg8aInGxAAyG9KSK5mPyHc6+hAwD6sag=="}' 2021-03-30T05:10:01.457 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 5ef98954-90ca-48ef-9f03-01ecccb04b01 -i td/ceph-helpers/0/new.json 2021-03-30T05:10:01.773 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:01.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:10:01.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCpsmJg8aInGxAAyG9KSK5mPyHc6+hAwD6sag== --osd-uuid 5ef98954-90ca-48ef-9f03-01ecccb04b01 2021-03-30T05:10:01.809 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:01.804+0000 7fb41353af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:01.809 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:01.806+0000 7fb41353af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:01.810 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:01.808+0000 7fb41353af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:01.811 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:01.809+0000 7fb41353af40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:01.811 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:01.809+0000 7fb41353af40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:01.812 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:01.809+0000 7fb41353af40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:01.885 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:01.883+0000 7fb41353af40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:10:02.304 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:02.302+0000 7fb41353af40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:10:05.012 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:10:05.013 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:10:05.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:10:05.015 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:10:05.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:10:05.526 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:10:05.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:10:05.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:05.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:10:05.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:10:05.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:10:05.547 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:05.546+0000 7f6d1f583f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:05.548 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:05.548+0000 7f6d1f583f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:05.550 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:05.549+0000 7f6d1f583f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:05.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:10:05.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:10:05.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:10:05.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:10:05.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:10:05.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:05.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:10:05.891 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:05.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:05.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:06.065 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:06.065+0000 7f6d1f583f40 -1 Falling back to public interface 2021-03-30T05:10:06.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:10:06.752 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:06.752+0000 7f6d1f583f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:10:07.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:10:07.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:07.247 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:10:07.247 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:10:07.248 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:07.248 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:07.640 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/47914,v1:127.0.0.1:6803/47914] [v2:127.0.0.1:6804/47914,v1:127.0.0.1:6805/47914] exists,up 5ef98954-90ca-48ef-9f03-01ecccb04b01 2021-03-30T05:10:07.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:10:07.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:10:07.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:10:07.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1477: test_get_last_scrub_stamp: create_rbd_pool 2021-03-30T05:10:07.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:10:08.012 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:10:08.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:10:08.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:10:08.723 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:10:08.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:10:09.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:10:10.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1478: test_get_last_scrub_stamp: wait_for_clean 2021-03-30T05:10:10.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:10:10.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:10:10.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:10:10.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:10:10.722 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:10:10.722 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:10:10.722 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:10:10.722 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:10:10.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:10:10.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:10:10.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:10:10.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:10:10.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:10:10.821 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:10:10.821 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:10:11.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:10:11.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:10:11.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:10:11.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:10:11.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:10:11.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:10:11.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:10:11.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:10:11.303 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:10:11.303 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:10:11.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:10:11.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:10:11.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:10:11.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:10:11.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:10:11.305 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:10:11.306 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:10:11.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:10:11.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:10:12.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:10:12.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:10:13.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:10:13.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:10:13.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:10:13.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:10:13.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:10:13.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:10:13.507 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:10:13.507 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:10:13.507 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:10:13.507 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:10:13.507 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:10:13.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:10:13.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:10:13.846 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:10:13.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:10:13.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:10:14.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:10:14.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:10:14.309 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:10:14.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1479: test_get_last_scrub_stamp: get_last_scrub_stamp 1.0 2021-03-30T05:10:14.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:10:14.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:10:14.310 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:10:14.310 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:10:14.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1479: test_get_last_scrub_stamp: stamp=2021-03-30T05:10:08.392979+0000 2021-03-30T05:10:14.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1480: test_get_last_scrub_stamp: test -n 2021-03-30T05:10:08.392979+0000 2021-03-30T05:10:14.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1481: test_get_last_scrub_stamp: teardown td/ceph-helpers 2021-03-30T05:10:14.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:10:14.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:10:14.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:10:14.653 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:10:14.653 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:10:14.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:10:14.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:10:14.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:10:14.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:10:14.757 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:10:14.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:10:14.758 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:10:14.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:10:14.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:10:14.759 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:10:14.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:14.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:10:14.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:10:14.761 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:14.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:10:14.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:10:14.763 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:10:14.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:10:14.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:14.765 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:14.766 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:10:14.768 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:10:14.768 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:10:14.768 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:10:14.769 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_not_primary td/ceph-helpers 2021-03-30T05:10:14.769 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1176: test_get_not_primary: local dir=td/ceph-helpers 2021-03-30T05:10:14.769 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1178: test_get_not_primary: setup td/ceph-helpers 2021-03-30T05:10:14.769 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:10:14.769 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:10:14.770 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:10:14.770 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:10:14.770 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:10:14.770 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:10:14.771 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:10:14.771 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:10:14.771 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:10:14.771 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:10:14.771 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:10:14.773 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:10:14.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:10:14.774 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:10:14.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:10:14.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:10:14.775 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:10:14.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:14.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:10:14.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:10:14.776 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:14.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:10:14.779 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:10:14.780 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:10:14.780 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:10:14.780 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:14.780 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:14.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:10:14.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:10:14.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:10:14.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:10:14.781 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:10:14.782 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:14.782 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:14.782 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:10:14.782 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:10:14.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:10:14.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:10:14.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:10:14.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1179: test_get_not_primary: run_mon td/ceph-helpers a --osd_pool_default_size=2 2021-03-30T05:10:14.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:10:14.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:10:14.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:10:14.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:10:14.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:10:14.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2021-03-30T05:10:15.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:10:15.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:15.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:15.110 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:15.110 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:15.110 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:15.110 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:15.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2021-03-30T05:10:15.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:10:15.296 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:10:15.296 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:15.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:15.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:10:15.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:10:15.297 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:15.297 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:15.298 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:15.298 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:15.298 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:15.298 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:15.299 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:15.299 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:15.299 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:10:15.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:10:15.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:15.384 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:15.384 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:10:15.384 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:10:15.384 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:15.384 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:15.385 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:15.385 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:15.385 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:15.385 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:15.385 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:15.386 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:15.386 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:10:15.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1180: test_get_not_primary: run_mgr td/ceph-helpers x 2021-03-30T05:10:15.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:10:15.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:10:15.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:10:15.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:10:15.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:10:15.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:10:16.340 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:10:16.341 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:16.341 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:16.341 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:16.342 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:16.342 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:16.342 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:16.342 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:16.343 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:16.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1181: test_get_not_primary: run_osd td/ceph-helpers 0 2021-03-30T05:10:16.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:10:16.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:10:16.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:10:16.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:10:16.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:10:16.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:10:16.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:10:16.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:10:16.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:10:16.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:10:16.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:10:16.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:10:16.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:10:16.368 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:10:16.368 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:10:16.369 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:16.369 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:16.369 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:16.369 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:16.370 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:16.370 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:16.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:16.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:10:16.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:10:16.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:10:16.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:10:16.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:10:16.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:10:16.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:10:16.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:16.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:10:16.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:10:16.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:10:16.372 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:10:16.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e11acb82-b468-4d4b-bf73-9ce752120689 2021-03-30T05:10:16.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 e11acb82-b468-4d4b-bf73-9ce752120689' 2021-03-30T05:10:16.373 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 e11acb82-b468-4d4b-bf73-9ce752120689 2021-03-30T05:10:16.373 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:10:16.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC4smJgwfWUFhAATReue0u6V+M3tTxa/2Ks+g== 2021-03-30T05:10:16.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC4smJgwfWUFhAATReue0u6V+M3tTxa/2Ks+g=="}' 2021-03-30T05:10:16.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e11acb82-b468-4d4b-bf73-9ce752120689 -i td/ceph-helpers/0/new.json 2021-03-30T05:10:16.697 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:16.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:10:16.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC4smJgwfWUFhAATReue0u6V+M3tTxa/2Ks+g== --osd-uuid e11acb82-b468-4d4b-bf73-9ce752120689 2021-03-30T05:10:16.730 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:16.729+0000 7fa8dc286f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:16.732 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:16.731+0000 7fa8dc286f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:16.733 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:16.733+0000 7fa8dc286f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:16.734 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:16.734+0000 7fa8dc286f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:16.735 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:16.734+0000 7fa8dc286f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:16.735 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:16.734+0000 7fa8dc286f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:16.817 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:16.816+0000 7fa8dc286f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:10:17.194 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:17.194+0000 7fa8dc286f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:10:19.928 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:10:19.928 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:10:19.929 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:10:19.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:10:19.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:10:20.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:10:20.397 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:10:20.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:20.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:10:20.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:10:20.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:10:20.416 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:20.416+0000 7fa456117f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:20.418 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:20.418+0000 7fa456117f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:20.420 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:20.420+0000 7fa456117f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:20.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:10:20.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:10:20.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:10:20.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:10:20.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:10:20.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:20.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:10:20.762 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:20.763 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:20.763 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:20.936 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:20.936+0000 7fa456117f40 -1 Falling back to public interface 2021-03-30T05:10:21.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:10:21.718 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:21.717+0000 7fa456117f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:10:22.116 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:10:22.116 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:22.116 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:10:22.117 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:10:22.117 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:22.117 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:22.474 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/48949,v1:127.0.0.1:6803/48949] [v2:127.0.0.1:6804/48949,v1:127.0.0.1:6805/48949] exists,up e11acb82-b468-4d4b-bf73-9ce752120689 2021-03-30T05:10:22.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:10:22.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:10:22.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:10:22.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1182: test_get_not_primary: run_osd td/ceph-helpers 1 2021-03-30T05:10:22.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:10:22.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:10:22.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:10:22.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:10:22.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:10:22.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:10:22.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:10:22.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:10:22.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:10:22.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:10:22.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:10:22.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:10:22.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:10:22.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:10:22.482 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:10:22.483 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:22.483 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:22.483 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:22.483 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:22.484 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:22.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:22.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:22.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:10:22.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:10:22.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:10:22.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:10:22.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:10:22.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:10:22.485 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:10:22.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:22.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:10:22.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:10:22.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:10:22.486 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:10:22.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3fc05572-6647-4649-a4bf-f3590a379395 2021-03-30T05:10:22.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 3fc05572-6647-4649-a4bf-f3590a379395' 2021-03-30T05:10:22.487 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 3fc05572-6647-4649-a4bf-f3590a379395 2021-03-30T05:10:22.488 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:10:22.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC+smJgDY9JHRAANUjChjFnJuWXPxoLn/KcXA== 2021-03-30T05:10:22.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC+smJgDY9JHRAANUjChjFnJuWXPxoLn/KcXA=="}' 2021-03-30T05:10:22.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3fc05572-6647-4649-a4bf-f3590a379395 -i td/ceph-helpers/1/new.json 2021-03-30T05:10:23.001 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:10:23.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/1/new.json 2021-03-30T05:10:23.012 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC+smJgDY9JHRAANUjChjFnJuWXPxoLn/KcXA== --osd-uuid 3fc05572-6647-4649-a4bf-f3590a379395 2021-03-30T05:10:23.033 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.033+0000 7fd23b13af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:23.035 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.035+0000 7fd23b13af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:23.037 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.036+0000 7fd23b13af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:23.037 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.037+0000 7fd23b13af40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:10:23.038 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.037+0000 7fd23b13af40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:10:23.038 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.037+0000 7fd23b13af40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:10:23.091 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.091+0000 7fd23b13af40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2021-03-30T05:10:23.677 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:23.677+0000 7fd23b13af40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:10:26.529 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/1/keyring 2021-03-30T05:10:26.529 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:10:26.530 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:10:26.530 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:10:26.530 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:10:27.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:10:27.005 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:10:27.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:27.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:10:27.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:10:27.006 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:10:27.024 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:27.024+0000 7fd42c3d1f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:27.026 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:27.026+0000 7fd42c3d1f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:27.028 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:27.028+0000 7fd42c3d1f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:27.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:10:27.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:10:27.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:10:27.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:10:27.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:10:27.381 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:27.381 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:27.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:10:27.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:27.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:10:27.544 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:27.544+0000 7fd42c3d1f40 -1 Falling back to public interface 2021-03-30T05:10:27.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:10:28.276 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:28.275+0000 7fd42c3d1f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:10:28.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:10:28.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:28.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:10:28.739 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:10:28.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:28.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:10:29.137 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/49304,v1:127.0.0.1:6811/49304] [v2:127.0.0.1:6812/49304,v1:127.0.0.1:6813/49304] exists,up 3fc05572-6647-4649-a4bf-f3590a379395 2021-03-30T05:10:29.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:10:29.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:10:29.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:10:29.139 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1183: test_get_not_primary: create_rbd_pool 2021-03-30T05:10:29.139 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:10:29.493 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:10:29.501 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:10:29.502 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:10:30.036 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:10:30.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:10:31.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:10:32.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1184: test_get_not_primary: wait_for_clean 2021-03-30T05:10:32.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:10:32.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:10:32.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:10:32.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:10:32.434 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:10:32.434 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:10:32.435 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:10:32.435 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:10:32.435 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:10:32.435 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:10:32.531 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:10:32.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:10:32.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:10:32.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:10:32.532 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:10:32.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:10:32.885 INFO:tasks.workunit.client.0.smithi197.stderr:1' 2021-03-30T05:10:32.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:10:32.886 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:10:32.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:10:33.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836485 2021-03-30T05:10:33.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836485 2021-03-30T05:10:33.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836485' 2021-03-30T05:10:33.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:10:33.010 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:10:33.134 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=38654705667 2021-03-30T05:10:33.134 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 38654705667 2021-03-30T05:10:33.134 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836485 1-38654705667' 2021-03-30T05:10:33.134 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:10:33.135 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836485 2021-03-30T05:10:33.136 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:10:33.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:10:33.136 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836485 2021-03-30T05:10:33.136 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:10:33.137 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836485 2021-03-30T05:10:33.137 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2021-03-30T05:10:33.138 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836485 2021-03-30T05:10:33.138 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:10:33.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836485 2021-03-30T05:10:33.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:10:34.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:10:34.505 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:10:34.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836486 -lt 21474836485 2021-03-30T05:10:34.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:10:34.867 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-38654705667 2021-03-30T05:10:34.867 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:10:34.867 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:10:34.868 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-38654705667 2021-03-30T05:10:34.868 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:10:34.869 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=38654705667 2021-03-30T05:10:34.869 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2021-03-30T05:10:34.869 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 38654705667 2021-03-30T05:10:34.870 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:10:35.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 38654705667 -lt 38654705667 2021-03-30T05:10:35.221 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:10:35.221 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:10:35.221 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:10:35.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:10:35.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:10:35.720 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:10:35.720 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:10:35.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:10:35.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:10:35.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:10:35.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:10:36.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:10:36.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:10:36.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:10:36.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:10:36.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:10:36.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:10:36.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:10:36.533 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1185: test_get_not_primary: get_primary rbd GROUP 2021-03-30T05:10:36.533 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=rbd 2021-03-30T05:10:36.533 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=GROUP 2021-03-30T05:10:36.533 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map rbd GROUP 2021-03-30T05:10:36.534 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2021-03-30T05:10:36.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1185: test_get_not_primary: local primary=1 2021-03-30T05:10:36.885 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1186: test_get_not_primary: get_not_primary rbd GROUP 2021-03-30T05:10:36.885 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1167: get_not_primary: local poolname=rbd 2021-03-30T05:10:36.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: get_not_primary: local objectname=GROUP 2021-03-30T05:10:36.886 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: get_primary rbd GROUP 2021-03-30T05:10:36.886 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=rbd 2021-03-30T05:10:36.886 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=GROUP 2021-03-30T05:10:36.886 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map rbd GROUP 2021-03-30T05:10:36.887 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2021-03-30T05:10:37.239 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1170: get_not_primary: local primary=1 2021-03-30T05:10:37.239 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1171: get_not_primary: ceph --format json osd map rbd GROUP 2021-03-30T05:10:37.239 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1172: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2021-03-30T05:10:37.594 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1186: test_get_not_primary: local not_primary=0 2021-03-30T05:10:37.595 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: test_get_not_primary: test 0 '!=' 1 2021-03-30T05:10:37.595 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: test_get_not_primary: test 0 = 0 -o 0 = 1 2021-03-30T05:10:37.595 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1189: test_get_not_primary: teardown td/ceph-helpers 2021-03-30T05:10:37.595 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:10:37.595 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:10:37.596 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:10:37.596 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:10:37.596 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:10:37.596 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:10:37.596 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:10:37.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:10:37.701 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:10:37.702 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:10:37.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:10:37.703 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:10:37.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:10:37.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:10:37.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:10:37.706 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:37.706 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:10:37.706 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:10:37.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:37.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:10:37.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:10:37.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:10:37.711 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:10:37.711 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:37.711 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:37.711 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:10:37.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:10:37.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:10:37.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:10:37.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_num_active_clean td/ceph-helpers 2021-03-30T05:10:37.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1310: test_get_num_active_clean: local dir=td/ceph-helpers 2021-03-30T05:10:37.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1312: test_get_num_active_clean: setup td/ceph-helpers 2021-03-30T05:10:37.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:10:37.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:10:37.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:10:37.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:10:37.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:10:37.716 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:10:37.716 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:10:37.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:10:37.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:10:37.717 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:10:37.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:10:37.718 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:10:37.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:10:37.719 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:10:37.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:10:37.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:10:37.719 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:10:37.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:37.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:10:37.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:10:37.720 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:37.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:10:37.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:10:37.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:10:37.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:10:37.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:37.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:37.723 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:10:37.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:10:37.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:10:37.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:10:37.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:10:37.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:37.725 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:37.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:10:37.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:10:37.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:10:37.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:10:37.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:10:37.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1313: test_get_num_active_clean: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:10:37.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:10:37.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:10:37.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:10:37.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:10:37.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:10:37.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:10:38.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:10:38.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:38.018 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:38.018 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:38.018 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:38.018 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:38.019 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:38.019 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:10:38.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:10:38.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:10:38.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:38.187 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:38.187 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:10:38.187 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:10:38.187 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:38.188 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:38.188 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:38.188 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:38.188 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:38.188 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:38.189 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:38.189 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:38.189 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:10:38.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:10:38.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:38.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:38.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:10:38.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:10:38.276 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:38.276 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:38.276 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:38.276 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:38.277 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:38.277 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:38.277 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:38.277 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:38.277 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:10:38.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1314: test_get_num_active_clean: run_mgr td/ceph-helpers x 2021-03-30T05:10:38.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:10:38.362 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:10:38.362 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:10:38.362 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:10:38.362 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:10:38.363 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:10:39.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:10:39.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:39.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:39.275 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:39.275 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:39.276 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:39.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:39.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:39.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:39.299 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1315: test_get_num_active_clean: run_osd td/ceph-helpers 0 2021-03-30T05:10:39.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:10:39.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:10:39.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:10:39.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:10:39.300 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:10:39.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:10:39.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:10:39.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:10:39.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:10:39.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:10:39.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:10:39.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:10:39.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:10:39.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:10:39.303 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:10:39.303 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:39.303 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:39.303 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:39.304 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:39.304 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:39.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:39.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:39.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:10:39.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:10:39.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:10:39.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:10:39.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:10:39.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:10:39.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:10:39.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:39.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:10:39.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:10:39.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:10:39.307 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:10:39.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=3bc009ae-bfad-4af7-a073-3fe85c82e285 2021-03-30T05:10:39.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 3bc009ae-bfad-4af7-a073-3fe85c82e285' 2021-03-30T05:10:39.307 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 3bc009ae-bfad-4af7-a073-3fe85c82e285 2021-03-30T05:10:39.308 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:10:39.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDPsmJgRDanEhAAmgi+/+LiLx2xACIdm8rVOQ== 2021-03-30T05:10:39.314 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDPsmJgRDanEhAAmgi+/+LiLx2xACIdm8rVOQ=="}' 2021-03-30T05:10:39.314 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 3bc009ae-bfad-4af7-a073-3fe85c82e285 -i td/ceph-helpers/0/new.json 2021-03-30T05:10:39.655 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:39.664 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:10:39.665 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDPsmJgRDanEhAAmgi+/+LiLx2xACIdm8rVOQ== --osd-uuid 3bc009ae-bfad-4af7-a073-3fe85c82e285 2021-03-30T05:10:39.687 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:39.686+0000 7f4e6e7e0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:39.689 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:39.688+0000 7f4e6e7e0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:39.691 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:39.689+0000 7f4e6e7e0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:39.692 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:39.690+0000 7f4e6e7e0f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:39.692 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:39.690+0000 7f4e6e7e0f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:39.692 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:39.690+0000 7f4e6e7e0f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:39.767 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:39.765+0000 7f4e6e7e0f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:10:40.202 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:40.201+0000 7f4e6e7e0f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:10:42.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:10:42.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:10:42.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:10:42.830 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:10:42.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:10:43.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:10:43.060 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:10:43.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:43.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:10:43.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:10:43.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:10:43.079 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:43.078+0000 7f1adaaf4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:43.081 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:43.080+0000 7f1adaaf4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:43.082 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:43.081+0000 7f1adaaf4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:43.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:10:43.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:10:43.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:10:43.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:10:43.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:10:43.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:43.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:10:43.434 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:43.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:43.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:43.598 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:43.596+0000 7f1adaaf4f40 -1 Falling back to public interface 2021-03-30T05:10:43.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:10:44.368 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:44.367+0000 7f1adaaf4f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:10:44.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:10:44.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:44.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:10:44.791 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:10:44.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:44.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:45.193 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/50447,v1:127.0.0.1:6803/50447] [v2:127.0.0.1:6804/50447,v1:127.0.0.1:6805/50447] exists,up 3bc009ae-bfad-4af7-a073-3fe85c82e285 2021-03-30T05:10:45.194 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:10:45.194 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:10:45.194 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:10:45.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1316: test_get_num_active_clean: create_rbd_pool 2021-03-30T05:10:45.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:10:45.578 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:10:45.586 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:10:45.586 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:10:46.104 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:10:46.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:10:47.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:10:48.010 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1317: test_get_num_active_clean: wait_for_clean 2021-03-30T05:10:48.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:10:48.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:10:48.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:10:48.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:10:48.012 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:10:48.012 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:10:48.012 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:10:48.012 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:10:48.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:10:48.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:10:48.109 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:10:48.109 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:10:48.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:10:48.110 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:10:48.110 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:10:48.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:10:48.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:10:48.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:10:48.494 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:10:48.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836484 2021-03-30T05:10:48.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836484 2021-03-30T05:10:48.620 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836484' 2021-03-30T05:10:48.620 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:10:48.620 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836484 2021-03-30T05:10:48.620 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:10:48.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:10:48.622 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836484 2021-03-30T05:10:48.622 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:10:48.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836484 2021-03-30T05:10:48.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2021-03-30T05:10:48.623 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836484 2021-03-30T05:10:48.623 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:10:48.993 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836484 -lt 21474836484 2021-03-30T05:10:48.993 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:10:48.993 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:10:48.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:10:49.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:10:49.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:10:49.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:10:49.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:10:49.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:10:49.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:10:49.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:10:49.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:10:49.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:10:49.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:10:49.795 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:10:49.795 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:10:50.256 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:10:50.257 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:10:50.257 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:10:50.257 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1318: test_get_num_active_clean: get_num_active_clean 2021-03-30T05:10:50.257 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:10:50.257 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:10:50.258 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:10:50.258 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:10:50.258 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:10:50.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1318: test_get_num_active_clean: local num_active_clean=4 2021-03-30T05:10:50.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1319: test_get_num_active_clean: test 4 = 4 2021-03-30T05:10:50.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1320: test_get_num_active_clean: teardown td/ceph-helpers 2021-03-30T05:10:50.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:10:50.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:10:50.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:10:50.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:10:50.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:10:50.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:10:50.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:10:50.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:10:50.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:10:50.716 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:10:50.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:10:50.717 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:10:50.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:10:50.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:10:50.718 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:10:50.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:50.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:10:50.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:10:50.720 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:50.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:10:50.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:10:50.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:10:50.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:10:50.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:50.724 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:50.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:10:50.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:10:50.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:10:50.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:10:50.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_num_active_or_peered td/ceph-helpers 2021-03-30T05:10:50.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: test_get_num_active_or_peered: local dir=td/ceph-helpers 2021-03-30T05:10:50.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1342: test_get_num_active_or_peered: setup td/ceph-helpers 2021-03-30T05:10:50.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:10:50.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:10:50.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:10:50.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:10:50.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:10:50.729 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:10:50.729 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:10:50.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:10:50.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:10:50.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:10:50.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:10:50.732 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:10:50.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:10:50.732 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:10:50.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:10:50.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:10:50.733 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:10:50.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:50.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:10:50.734 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:10:50.734 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:10:50.734 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:10:50.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:10:50.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:10:50.736 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:10:50.737 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:50.737 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:50.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:10:50.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:10:50.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:10:50.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:10:50.738 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:10:50.738 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:50.738 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:50.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:10:50.740 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:10:50.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:10:50.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:10:50.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:10:50.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1343: test_get_num_active_or_peered: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:10:50.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:10:50.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:10:50.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:10:50.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:10:50.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:10:50.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:10:51.054 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:10:51.055 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:51.055 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:51.055 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:51.055 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:51.055 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:51.056 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:51.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:10:51.215 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:10:51.217 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:10:51.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:51.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:51.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:10:51.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:10:51.218 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:51.219 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:51.219 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:51.219 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:51.219 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:51.220 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:51.220 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:51.220 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:51.220 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:10:51.304 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:10:51.305 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:10:51.305 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:10:51.305 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:10:51.306 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:10:51.306 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:10:51.306 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:10:51.306 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:10:51.306 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:10:51.307 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:51.307 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:51.307 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:10:51.307 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:10:51.307 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:10:51.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1344: test_get_num_active_or_peered: run_mgr td/ceph-helpers x 2021-03-30T05:10:51.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:10:51.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:10:51.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:10:51.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:10:51.393 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:10:51.393 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:10:52.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:10:52.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:52.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:52.281 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:52.281 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:52.281 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:52.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:52.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:52.282 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:10:52.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1345: test_get_num_active_or_peered: run_osd td/ceph-helpers 0 2021-03-30T05:10:52.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:10:52.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:10:52.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:10:52.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:10:52.306 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:10:52.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:10:52.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:10:52.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:10:52.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:10:52.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:10:52.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:10:52.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:10:52.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:10:52.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:10:52.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:10:52.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:10:52.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:10:52.309 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:10:52.310 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:10:52.310 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:10:52.310 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:52.310 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:10:52.310 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:10:52.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:10:52.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:10:52.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:10:52.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:10:52.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:10:52.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:10:52.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:52.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:10:52.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:10:52.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:10:52.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:10:52.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=5209d01c-85e7-4105-bf0f-2b4e4054275a 2021-03-30T05:10:52.313 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 5209d01c-85e7-4105-bf0f-2b4e4054275a 2021-03-30T05:10:52.314 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 5209d01c-85e7-4105-bf0f-2b4e4054275a' 2021-03-30T05:10:52.314 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:10:52.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDcsmJgASoCExAAp8kkSkjQaoU5dBWDcuzpvg== 2021-03-30T05:10:52.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDcsmJgASoCExAAp8kkSkjQaoU5dBWDcuzpvg=="}' 2021-03-30T05:10:52.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 5209d01c-85e7-4105-bf0f-2b4e4054275a -i td/ceph-helpers/0/new.json 2021-03-30T05:10:52.628 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:52.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:10:52.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDcsmJgASoCExAAp8kkSkjQaoU5dBWDcuzpvg== --osd-uuid 5209d01c-85e7-4105-bf0f-2b4e4054275a 2021-03-30T05:10:52.660 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:52.660+0000 7faf083f6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:52.662 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:52.662+0000 7faf083f6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:52.664 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:52.664+0000 7faf083f6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:52.665 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:52.665+0000 7faf083f6f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:52.665 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:52.665+0000 7faf083f6f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:52.666 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:52.665+0000 7faf083f6f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:10:52.706 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:52.706+0000 7faf083f6f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:10:53.109 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:53.108+0000 7faf083f6f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:10:55.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:10:55.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:10:55.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:10:55.844 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:10:55.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:10:56.319 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:10:56.320 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:10:56.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:10:56.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:10:56.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:10:56.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:10:56.339 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:56.339+0000 7fd3a291df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:56.341 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:56.340+0000 7fd3a291df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:56.342 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:56.342+0000 7fd3a291df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:10:56.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:10:56.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:10:56.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:10:56.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:10:56.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:10:56.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:56.686 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:10:56.686 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:10:56.687 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:56.688 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:56.859 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:56.858+0000 7fd3a291df40 -1 Falling back to public interface 2021-03-30T05:10:57.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:10:57.595 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:10:57.594+0000 7fd3a291df40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:10:58.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:10:58.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:10:58.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:10:58.037 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:10:58.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:10:58.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:10:58.398 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/51444,v1:127.0.0.1:6803/51444] [v2:127.0.0.1:6804/51444,v1:127.0.0.1:6805/51444] exists,up 5209d01c-85e7-4105-bf0f-2b4e4054275a 2021-03-30T05:10:58.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:10:58.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:10:58.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:10:58.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1346: test_get_num_active_or_peered: create_rbd_pool 2021-03-30T05:10:58.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:10:58.809 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:10:58.817 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:10:58.817 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:10:59.338 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:10:59.346 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:11:00.347 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:11:01.343 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1347: test_get_num_active_or_peered: wait_for_clean 2021-03-30T05:11:01.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:11:01.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:11:01.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:11:01.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:11:01.345 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:11:01.345 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:11:01.345 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:11:01.345 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:11:01.345 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:11:01.346 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:11:01.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:11:01.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:11:01.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:11:01.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:11:01.442 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:11:01.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:11:01.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:11:01.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:11:01.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:11:01.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836484 2021-03-30T05:11:01.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836484 2021-03-30T05:11:01.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836484' 2021-03-30T05:11:01.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:11:01.923 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836484 2021-03-30T05:11:01.923 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:11:01.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:11:01.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836484 2021-03-30T05:11:01.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:11:01.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836484 2021-03-30T05:11:01.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2021-03-30T05:11:01.925 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836484 2021-03-30T05:11:01.926 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:02.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836482 -lt 21474836484 2021-03-30T05:11:02.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:11:03.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:11:03.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:03.634 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836482 -lt 21474836484 2021-03-30T05:11:03.634 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:11:04.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:11:04.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:04.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836484 -lt 21474836484 2021-03-30T05:11:04.997 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:11:04.997 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:04.997 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:05.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:11:05.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:11:05.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:11:05.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:11:05.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:11:05.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:11:05.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:11:05.458 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:11:05.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:11:05.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:11:05.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:05.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:06.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:11:06.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:11:06.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:11:06.270 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1348: test_get_num_active_or_peered: get_num_active_or_peered 2021-03-30T05:11:06.271 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1332: get_num_active_or_peered: local expression 2021-03-30T05:11:06.271 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1333: get_num_active_or_peered: expression+='select(contains("active") or contains("peered")) | ' 2021-03-30T05:11:06.271 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_num_active_or_peered: expression+='select(contains("stale") | not)' 2021-03-30T05:11:06.271 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_num_active_or_peered: ceph --format json pg dump pgs 2021-03-30T05:11:06.272 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_num_active_or_peered: jq '.pg_stats | [.[] | .state | select(contains("active") or contains("peered")) | select(contains("stale") | not)] | length' 2021-03-30T05:11:06.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1348: test_get_num_active_or_peered: local num_peered=4 2021-03-30T05:11:06.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1349: test_get_num_active_or_peered: test 4 = 4 2021-03-30T05:11:06.657 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1350: test_get_num_active_or_peered: teardown td/ceph-helpers 2021-03-30T05:11:06.657 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:11:06.657 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:11:06.657 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:11:06.658 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:11:06.658 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:11:06.658 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:11:06.658 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:11:06.658 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:11:06.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:11:06.761 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:11:06.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:11:06.762 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:11:06.763 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:11:06.764 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:11:06.764 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:11:06.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:06.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:11:06.766 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:11:06.766 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:06.767 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:11:06.767 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:11:06.767 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:11:06.769 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:11:06.770 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:06.770 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:06.770 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:11:06.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:11:06.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:11:06.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:11:06.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_num_pgs td/ceph-helpers 2021-03-30T05:11:06.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: test_get_num_pgs: local dir=td/ceph-helpers 2021-03-30T05:11:06.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1369: test_get_num_pgs: setup td/ceph-helpers 2021-03-30T05:11:06.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:11:06.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:11:06.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:11:06.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:11:06.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:11:06.776 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:11:06.776 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:11:06.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:11:06.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:11:06.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:11:06.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:11:06.777 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:11:06.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:11:06.780 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:11:06.780 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:11:06.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:11:06.781 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:11:06.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:06.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:11:06.781 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:11:06.782 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:06.782 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:11:06.782 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:11:06.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:11:06.783 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:11:06.783 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:06.783 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:06.783 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:11:06.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:11:06.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:11:06.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:11:06.786 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:11:06.786 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:06.787 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:06.787 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:11:06.787 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:11:06.787 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:11:06.787 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:11:06.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:11:06.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1370: test_get_num_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:11:06.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:11:06.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:11:06.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:11:06.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:11:06.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:11:06.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:11:07.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:11:07.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:07.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:07.080 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:07.080 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:07.080 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:07.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:07.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:11:07.233 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:11:07.235 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:11:07.235 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:11:07.235 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:11:07.235 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:11:07.236 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:11:07.236 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:11:07.236 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:11:07.236 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:11:07.237 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:11:07.237 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:07.237 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:07.237 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:11:07.237 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:11:07.238 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:11:07.321 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:11:07.322 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:11:07.322 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:11:07.322 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:11:07.322 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:11:07.322 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:11:07.323 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:11:07.323 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:11:07.323 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:11:07.323 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:07.324 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:07.324 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:11:07.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:11:07.324 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:11:07.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1371: test_get_num_pgs: run_mgr td/ceph-helpers x 2021-03-30T05:11:07.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:11:07.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:11:07.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:11:07.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:11:07.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:11:07.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:11:08.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:11:08.309 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:08.310 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:08.310 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:08.310 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:08.310 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:08.311 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:08.311 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:11:08.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:11:08.335 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1372: test_get_num_pgs: run_osd td/ceph-helpers 0 2021-03-30T05:11:08.335 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:11:08.335 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:11:08.335 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:11:08.336 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:11:08.336 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:11:08.336 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:11:08.336 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:11:08.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:11:08.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:11:08.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:11:08.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:11:08.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:11:08.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:11:08.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:11:08.338 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:11:08.338 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:08.338 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:08.339 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:08.339 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:08.339 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:08.339 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:08.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:08.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:11:08.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:11:08.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:11:08.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:11:08.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:11:08.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:11:08.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:11:08.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:08.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:11:08.342 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:11:08.342 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:11:08.342 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:11:08.342 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=17dca1fd-7bbc-4eb6-9571-7bc56795b2f6 2021-03-30T05:11:08.343 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 17dca1fd-7bbc-4eb6-9571-7bc56795b2f6' 2021-03-30T05:11:08.343 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 17dca1fd-7bbc-4eb6-9571-7bc56795b2f6 2021-03-30T05:11:08.343 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:11:08.349 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDssmJge3DDFBAAceTWzxpRwFC4B++O7xqEhQ== 2021-03-30T05:11:08.349 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDssmJge3DDFBAAceTWzxpRwFC4B++O7xqEhQ=="}' 2021-03-30T05:11:08.349 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 17dca1fd-7bbc-4eb6-9571-7bc56795b2f6 -i td/ceph-helpers/0/new.json 2021-03-30T05:11:08.689 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:11:08.699 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:11:08.700 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDssmJge3DDFBAAceTWzxpRwFC4B++O7xqEhQ== --osd-uuid 17dca1fd-7bbc-4eb6-9571-7bc56795b2f6 2021-03-30T05:11:08.722 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:08.721+0000 7f401f251f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:08.723 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:08.723+0000 7f401f251f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:08.725 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:08.724+0000 7f401f251f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:08.725 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:08.725+0000 7f401f251f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:08.725 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:08.725+0000 7f401f251f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:08.726 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:08.725+0000 7f401f251f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:08.766 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:08.765+0000 7f401f251f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:11:09.243 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:09.242+0000 7f401f251f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:11:11.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:11:11.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:11:11.892 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:11:11.893 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:11:11.893 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:11:12.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:11:12.366 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:11:12.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:12.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:11:12.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:11:12.367 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:11:12.385 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:12.384+0000 7fdde9478f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:12.512 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:12.386+0000 7fdde9478f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:12.512 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:12.387+0000 7fdde9478f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:12.761 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:11:12.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:11:12.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:11:12.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:11:12.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:11:12.763 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:12.763 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:11:12.763 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:11:12.764 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:12.764 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:11:12.903 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:12.902+0000 7fdde9478f40 -1 Falling back to public interface 2021-03-30T05:11:13.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:11:13.638 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:13.636+0000 7fdde9478f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:11:14.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:11:14.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:14.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:11:14.115 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:11:14.115 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:14.115 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:11:14.470 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/52495,v1:127.0.0.1:6803/52495] [v2:127.0.0.1:6804/52495,v1:127.0.0.1:6805/52495] exists,up 17dca1fd-7bbc-4eb6-9571-7bc56795b2f6 2021-03-30T05:11:14.471 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:11:14.471 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:11:14.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:11:14.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1373: test_get_num_pgs: create_rbd_pool 2021-03-30T05:11:14.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:11:14.892 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:11:14.900 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:11:14.901 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:11:15.404 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:11:15.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:11:16.414 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:11:17.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1374: test_get_num_pgs: wait_for_clean 2021-03-30T05:11:17.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:11:17.296 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:11:17.296 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:11:17.296 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:11:17.296 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:11:17.296 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:11:17.297 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:11:17.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:11:17.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:11:17.297 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:11:17.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:11:17.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:11:17.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:11:17.394 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:11:17.394 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:11:17.753 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:11:17.754 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:11:17.754 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:11:17.754 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:11:17.876 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:11:17.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:11:17.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:11:17.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:11:17.878 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:11:17.878 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:11:17.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:11:17.879 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:11:17.880 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:11:17.880 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:11:17.880 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:11:17.880 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:11:17.881 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:18.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:11:18.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:11:19.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:11:19.240 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:19.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:11:19.602 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:11:20.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:11:20.604 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:20.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:11:20.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:11:20.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:20.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:21.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:11:21.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:11:21.431 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:11:21.431 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:11:21.432 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:11:21.432 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:11:21.432 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:11:21.432 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:11:21.771 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:11:21.771 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:11:21.771 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:21.771 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:22.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:11:22.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:11:22.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:11:22.231 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1375: test_get_num_pgs: get_num_pgs 2021-03-30T05:11:22.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:22.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:22.713 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1375: test_get_num_pgs: local num_pgs=4 2021-03-30T05:11:22.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1376: test_get_num_pgs: test 4 -gt 0 2021-03-30T05:11:22.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1377: test_get_num_pgs: teardown td/ceph-helpers 2021-03-30T05:11:22.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:11:22.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:11:22.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:11:22.715 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:11:22.715 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:11:22.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:11:22.715 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:11:22.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:11:22.818 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:11:22.819 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:11:22.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:11:22.820 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:11:22.821 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:11:22.821 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:11:22.821 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:11:22.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:22.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:11:22.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:11:22.823 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:22.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:11:22.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:11:22.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:11:22.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:11:22.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:22.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:22.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:11:22.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:11:22.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:11:22.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:11:22.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_osd_id_used_by_pgs td/ceph-helpers 2021-03-30T05:11:22.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1397: test_get_osd_id_used_by_pgs: local dir=td/ceph-helpers 2021-03-30T05:11:22.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1399: test_get_osd_id_used_by_pgs: setup td/ceph-helpers 2021-03-30T05:11:22.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:11:22.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:11:22.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:11:22.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:11:22.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:11:22.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:11:22.833 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:11:22.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:11:22.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:11:22.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:11:22.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:11:22.835 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:11:22.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:11:22.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:11:22.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:11:22.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:11:22.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:11:22.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:22.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:11:22.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:11:22.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:22.838 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:11:22.838 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:11:22.838 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:11:22.841 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:11:22.841 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:22.841 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:22.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:11:22.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:11:22.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:11:22.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:11:22.842 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:11:22.842 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:22.843 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:22.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:11:22.843 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:11:22.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:11:22.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:11:22.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:11:22.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1400: test_get_osd_id_used_by_pgs: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:11:22.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:11:22.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:11:22.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:11:22.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:11:22.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:11:22.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:11:23.158 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:11:23.158 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:23.159 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:23.159 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:23.159 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:23.159 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:23.160 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:23.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:11:23.333 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:11:23.336 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:11:23.336 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:11:23.336 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:11:23.336 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:11:23.336 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:11:23.337 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:11:23.337 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:11:23.337 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:11:23.337 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:11:23.337 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:23.338 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:23.338 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:11:23.338 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:11:23.338 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:11:23.422 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:11:23.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:11:23.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:11:23.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:11:23.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:11:23.423 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:11:23.424 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:11:23.424 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:11:23.424 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:11:23.424 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:23.424 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:23.425 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:11:23.425 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:11:23.425 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:11:23.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1401: test_get_osd_id_used_by_pgs: run_mgr td/ceph-helpers x 2021-03-30T05:11:23.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:11:23.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:11:23.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:11:23.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:11:23.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:11:23.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:11:24.390 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:11:24.390 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:24.390 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:24.391 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:24.391 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:24.391 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:24.391 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:24.392 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:11:24.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:11:24.415 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1402: test_get_osd_id_used_by_pgs: run_osd td/ceph-helpers 0 2021-03-30T05:11:24.416 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:11:24.416 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:11:24.416 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:11:24.416 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:11:24.417 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:11:24.417 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:11:24.417 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:11:24.417 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:11:24.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:11:24.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:11:24.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:11:24.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:11:24.419 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:11:24.419 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:11:24.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:11:24.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:24.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:24.420 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:24.420 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:24.420 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:24.420 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:24.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:24.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:11:24.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:11:24.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:11:24.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:11:24.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:11:24.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:11:24.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:11:24.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:24.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:11:24.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:11:24.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:11:24.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:11:24.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=35365e3e-74d8-42a3-9480-7af32acd9fae 2021-03-30T05:11:24.424 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 35365e3e-74d8-42a3-9480-7af32acd9fae 2021-03-30T05:11:24.424 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 35365e3e-74d8-42a3-9480-7af32acd9fae' 2021-03-30T05:11:24.424 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:11:24.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD8smJgo8aQGRAA39ZNzbYNqQNGX3YYde7N4g== 2021-03-30T05:11:24.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD8smJgo8aQGRAA39ZNzbYNqQNGX3YYde7N4g=="}' 2021-03-30T05:11:24.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 35365e3e-74d8-42a3-9480-7af32acd9fae -i td/ceph-helpers/0/new.json 2021-03-30T05:11:24.748 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:11:24.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:11:24.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD8smJgo8aQGRAA39ZNzbYNqQNGX3YYde7N4g== --osd-uuid 35365e3e-74d8-42a3-9480-7af32acd9fae 2021-03-30T05:11:24.780 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:24.779+0000 7f92c54f8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:24.782 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:24.781+0000 7f92c54f8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:24.783 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:24.782+0000 7f92c54f8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:24.784 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:24.782+0000 7f92c54f8f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:24.784 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:24.782+0000 7f92c54f8f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:24.784 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:24.782+0000 7f92c54f8f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:24.825 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:24.823+0000 7f92c54f8f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:11:25.252 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:25.250+0000 7f92c54f8f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:11:27.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:11:27.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:11:27.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:11:27.904 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:11:27.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:11:28.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:11:28.159 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:11:28.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:28.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:11:28.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:11:28.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:11:28.179 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:28.178+0000 7f024af9ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:28.181 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:28.180+0000 7f024af9ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:28.182 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:28.182+0000 7f024af9ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:28.554 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:11:28.554 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:11:28.554 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:11:28.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:11:28.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:11:28.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:28.555 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:11:28.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:11:28.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:28.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:11:28.699 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:28.699+0000 7f024af9ef40 -1 Falling back to public interface 2021-03-30T05:11:28.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:11:29.442 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:29.441+0000 7f024af9ef40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:11:29.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:11:29.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:29.909 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:11:29.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:11:29.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:29.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:11:30.293 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/53554,v1:127.0.0.1:6803/53554] [v2:127.0.0.1:6804/53554,v1:127.0.0.1:6805/53554] exists,up 35365e3e-74d8-42a3-9480-7af32acd9fae 2021-03-30T05:11:30.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:11:30.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:11:30.294 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:11:30.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1403: test_get_osd_id_used_by_pgs: create_rbd_pool 2021-03-30T05:11:30.295 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:11:30.668 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:11:30.676 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:11:30.676 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:11:31.145 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:11:31.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:11:32.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:11:33.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1404: test_get_osd_id_used_by_pgs: wait_for_clean 2021-03-30T05:11:33.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:11:33.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:11:33.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:11:33.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:11:33.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:11:33.128 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:11:33.129 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:11:33.129 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:11:33.129 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:11:33.129 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:11:33.226 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:11:33.226 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:11:33.227 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:11:33.227 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:11:33.227 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:11:33.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:11:33.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:11:33.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:11:33.579 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:11:33.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:11:33.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:11:33.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:11:33.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:11:33.703 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:11:33.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:11:33.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:11:33.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:11:33.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:11:33.705 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:11:33.705 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:11:33.706 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:11:33.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:34.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:11:34.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:11:34.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:34.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:34.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:11:34.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:11:34.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:11:34.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:11:34.545 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:11:34.545 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:11:34.545 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:11:34.545 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:11:34.882 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:11:34.883 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:11:34.884 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:34.884 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:35.342 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:11:35.342 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:11:35.343 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:11:35.343 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1405: test_get_osd_id_used_by_pgs: get_osd_id_used_by_pgs 2021-03-30T05:11:35.343 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1405: test_get_osd_id_used_by_pgs: uniq 2021-03-30T05:11:35.343 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1393: get_osd_id_used_by_pgs: ceph --format json pg dump pgs 2021-03-30T05:11:35.344 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1393: get_osd_id_used_by_pgs: jq '.pg_stats | .[] | .up[], .acting[]' 2021-03-30T05:11:35.344 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1393: get_osd_id_used_by_pgs: sort 2021-03-30T05:11:35.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1405: test_get_osd_id_used_by_pgs: local osd_ids=0 2021-03-30T05:11:35.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1406: test_get_osd_id_used_by_pgs: test 0 = 0 2021-03-30T05:11:35.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1407: test_get_osd_id_used_by_pgs: teardown td/ceph-helpers 2021-03-30T05:11:35.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:11:35.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:11:35.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:11:35.685 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:11:35.686 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:11:35.686 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:11:35.686 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:11:35.686 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:11:35.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:11:35.789 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:11:35.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:11:35.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:11:35.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:11:35.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:11:35.791 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:11:35.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:35.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:11:35.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:11:35.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:35.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:11:35.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:11:35.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:11:35.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:11:35.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:35.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:35.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:11:35.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:11:35.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:11:35.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:11:35.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_osds td/ceph-helpers 2021-03-30T05:11:35.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: test_get_osds: local dir=td/ceph-helpers 2021-03-30T05:11:35.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:971: test_get_osds: setup td/ceph-helpers 2021-03-30T05:11:35.801 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:11:35.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:11:35.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:11:35.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:11:35.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:11:35.802 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:11:35.803 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:11:35.803 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:11:35.803 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:11:35.803 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:11:35.805 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:11:35.805 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:11:35.805 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:11:35.806 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:11:35.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:11:35.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:11:35.806 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:11:35.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:35.807 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:11:35.807 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:11:35.807 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:11:35.807 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:11:35.809 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:11:35.809 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:11:35.810 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:11:35.810 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:35.810 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:35.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:11:35.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:11:35.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:11:35.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:11:35.811 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:11:35.811 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:35.812 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:35.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:11:35.813 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:11:35.813 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:11:35.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:11:35.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:11:35.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: test_get_osds: run_mon td/ceph-helpers a --osd_pool_default_size=2 2021-03-30T05:11:35.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:11:35.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:11:35.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:11:35.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:11:35.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:11:35.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2021-03-30T05:11:36.115 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:11:36.115 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:36.115 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:36.116 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:36.116 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:36.116 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:36.116 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:36.117 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2021-03-30T05:11:36.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:11:36.292 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:11:36.292 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:11:36.293 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:11:36.293 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:11:36.293 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:11:36.293 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:11:36.293 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:11:36.294 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:11:36.294 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:11:36.294 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:36.294 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:36.295 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:11:36.295 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:11:36.295 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:11:36.380 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:11:36.380 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:11:36.381 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:11:36.381 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:11:36.381 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:11:36.381 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:11:36.381 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:11:36.382 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:11:36.382 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:11:36.382 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:36.382 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:36.383 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:11:36.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:11:36.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:11:36.467 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: test_get_osds: run_mgr td/ceph-helpers x 2021-03-30T05:11:36.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:11:36.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:11:36.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:11:36.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:11:36.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:11:36.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:11:36.940 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:11:36.940 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:36.941 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:36.941 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:36.941 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:36.941 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:36.942 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:36.942 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:11:36.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:11:36.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: test_get_osds: run_osd td/ceph-helpers 0 2021-03-30T05:11:36.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:11:36.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:11:36.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:11:36.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:11:36.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:11:36.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:11:36.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:11:36.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:11:36.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:11:36.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:11:36.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:11:36.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:11:36.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:11:36.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:11:36.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:11:36.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:36.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:36.969 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:36.969 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:36.969 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:36.969 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:36.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:36.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:11:36.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:11:36.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:11:36.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:11:36.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:11:36.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:11:36.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:11:36.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:36.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:11:36.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:11:36.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:11:36.972 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:11:36.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=b013ed59-1649-4a84-8b1e-8e7f688d172a 2021-03-30T05:11:36.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 b013ed59-1649-4a84-8b1e-8e7f688d172a' 2021-03-30T05:11:36.973 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 b013ed59-1649-4a84-8b1e-8e7f688d172a 2021-03-30T05:11:36.973 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:11:36.979 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAIs2JgxgdXOhAAtHyYmG9en7GuR6sJ7ifK9w== 2021-03-30T05:11:36.979 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAIs2JgxgdXOhAAtHyYmG9en7GuR6sJ7ifK9w=="}' 2021-03-30T05:11:36.980 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new b013ed59-1649-4a84-8b1e-8e7f688d172a -i td/ceph-helpers/0/new.json 2021-03-30T05:11:37.297 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:11:37.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:11:37.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAIs2JgxgdXOhAAtHyYmG9en7GuR6sJ7ifK9w== --osd-uuid b013ed59-1649-4a84-8b1e-8e7f688d172a 2021-03-30T05:11:37.329 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.329+0000 7fdd2837bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:37.331 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.331+0000 7fdd2837bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:37.332 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.332+0000 7fdd2837bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:37.333 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.332+0000 7fdd2837bf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:37.333 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.332+0000 7fdd2837bf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:37.333 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.332+0000 7fdd2837bf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:11:37.442 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.441+0000 7fdd2837bf40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:11:37.836 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:37.835+0000 7fdd2837bf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:11:40.478 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:11:40.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:11:40.479 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:11:40.480 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:11:40.480 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:11:40.717 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:11:40.718 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:11:40.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:40.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:11:40.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:11:40.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:11:40.738 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:40.737+0000 7f89187f0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:40.740 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:40.739+0000 7f89187f0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:40.741 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:40.741+0000 7f89187f0f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:41.087 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:11:41.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:11:41.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:11:41.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:11:41.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:11:41.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:41.089 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:11:41.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:11:41.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:41.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:11:41.260 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:41.260+0000 7f89187f0f40 -1 Falling back to public interface 2021-03-30T05:11:41.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:11:42.025 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:42.024+0000 7f89187f0f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:11:42.467 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:11:42.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:42.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:11:42.469 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:11:42.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:42.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:11:42.823 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/54554,v1:127.0.0.1:6803/54554] [v2:127.0.0.1:6804/54554,v1:127.0.0.1:6805/54554] exists,up b013ed59-1649-4a84-8b1e-8e7f688d172a 2021-03-30T05:11:42.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:11:42.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:11:42.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:11:42.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: test_get_osds: run_osd td/ceph-helpers 1 2021-03-30T05:11:42.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:11:42.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:11:42.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:11:42.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:11:42.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:11:42.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:11:42.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:11:42.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:11:42.830 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:11:42.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:11:42.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:11:42.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:11:42.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:11:42.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:11:42.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:11:42.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:11:42.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:11:42.832 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:11:42.833 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:11:42.833 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:11:42.833 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:42.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:11:42.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:11:42.834 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:11:42.834 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:11:42.834 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:11:42.834 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:11:42.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:11:42.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:11:42.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:42.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:11:42.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:11:42.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:11:42.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:11:42.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1db07d16-96ca-4d56-9b69-d27667fb754a 2021-03-30T05:11:42.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 1db07d16-96ca-4d56-9b69-d27667fb754a' 2021-03-30T05:11:42.837 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 1db07d16-96ca-4d56-9b69-d27667fb754a 2021-03-30T05:11:42.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:11:42.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAOs2Jgu14YMhAAjKfONhth//aqll6yZbaNew== 2021-03-30T05:11:42.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAOs2Jgu14YMhAAjKfONhth//aqll6yZbaNew=="}' 2021-03-30T05:11:42.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1db07d16-96ca-4d56-9b69-d27667fb754a -i td/ceph-helpers/1/new.json 2021-03-30T05:11:43.411 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:11:43.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/1/new.json 2021-03-30T05:11:43.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAOs2Jgu14YMhAAjKfONhth//aqll6yZbaNew== --osd-uuid 1db07d16-96ca-4d56-9b69-d27667fb754a 2021-03-30T05:11:43.443 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.443+0000 7f350e797f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:43.445 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.445+0000 7f350e797f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:43.446 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.446+0000 7f350e797f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:43.447 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.447+0000 7f350e797f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:11:43.447 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.447+0000 7f350e797f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:11:43.448 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.447+0000 7f350e797f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:11:43.525 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.525+0000 7f350e797f40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2021-03-30T05:11:43.911 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:43.910+0000 7f350e797f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:11:46.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/1/keyring 2021-03-30T05:11:46.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:11:46.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:11:46.637 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:11:46.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:11:47.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:11:47.113 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:11:47.113 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:11:47.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:11:47.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:11:47.114 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:11:47.132 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:47.132+0000 7fe0553b8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:47.134 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:47.133+0000 7fe0553b8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:47.135 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:47.135+0000 7fe0553b8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:11:47.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:11:47.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:11:47.481 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:11:47.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:11:47.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:11:47.482 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:47.482 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:11:47.483 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:11:47.483 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:47.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:11:47.651 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:47.650+0000 7fe0553b8f40 -1 Falling back to public interface 2021-03-30T05:11:47.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:11:48.409 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:11:48.409+0000 7fe0553b8f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:11:48.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:11:48.832 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:11:48.833 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:11:48.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:11:48.834 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:11:48.834 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:11:49.235 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/54909,v1:127.0.0.1:6811/54909] [v2:127.0.0.1:6812/54909,v1:127.0.0.1:6813/54909] exists,up 1db07d16-96ca-4d56-9b69-d27667fb754a 2021-03-30T05:11:49.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:11:49.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:11:49.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:11:49.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: test_get_osds: create_rbd_pool 2021-03-30T05:11:49.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:11:49.654 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:11:49.662 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:11:49.662 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:11:50.179 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:11:50.187 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:11:51.188 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:11:52.583 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: test_get_osds: wait_for_clean 2021-03-30T05:11:52.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:11:52.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:11:52.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:11:52.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:11:52.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:11:52.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:11:52.586 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:11:52.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:11:52.586 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:11:52.587 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:11:52.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:11:52.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:11:52.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:11:52.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:11:52.680 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:11:53.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:11:53.030 INFO:tasks.workunit.client.0.smithi197.stderr:1' 2021-03-30T05:11:53.030 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:11:53.030 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:11:53.030 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:11:53.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836485 2021-03-30T05:11:53.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836485 2021-03-30T05:11:53.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836485' 2021-03-30T05:11:53.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:11:53.153 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:11:53.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=42949672963 2021-03-30T05:11:53.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 42949672963 2021-03-30T05:11:53.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836485 1-42949672963' 2021-03-30T05:11:53.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:11:53.278 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836485 2021-03-30T05:11:53.278 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:11:53.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:11:53.279 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836485 2021-03-30T05:11:53.279 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:11:53.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836485 2021-03-30T05:11:53.280 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2021-03-30T05:11:53.280 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836485 2021-03-30T05:11:53.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:53.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836485 2021-03-30T05:11:53.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:11:54.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:11:54.630 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:11:54.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836486 -lt 21474836485 2021-03-30T05:11:54.993 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:11:54.993 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-42949672963 2021-03-30T05:11:54.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:11:54.994 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:11:54.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-42949672963 2021-03-30T05:11:54.995 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:11:54.995 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=42949672963 2021-03-30T05:11:54.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2021-03-30T05:11:54.996 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 42949672963 2021-03-30T05:11:54.997 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:11:55.346 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 42949672963 -lt 42949672963 2021-03-30T05:11:55.347 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:11:55.347 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:55.347 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:55.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:11:55.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:11:55.811 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:11:55.811 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:11:55.811 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:11:55.811 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:11:55.811 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:11:55.812 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:11:56.151 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:11:56.151 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:11:56.151 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:11:56.152 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:11:56.618 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:11:56.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:11:56.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:11:56.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: test_get_osds: create_rbd_pool 2021-03-30T05:11:56.619 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:11:57.113 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:11:57.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:11:57.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:11:57.806 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:11:57.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:11:58.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:12:00.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: test_get_osds: get_osds rbd GROUP 2021-03-30T05:12:00.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:959: get_osds: local poolname=rbd 2021-03-30T05:12:00.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:960: get_osds: local objectname=GROUP 2021-03-30T05:12:00.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: test_get_osds: grep --quiet '^[0-1] [0-1]$' 2021-03-30T05:12:00.070 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: ceph --format json osd map rbd GROUP 2021-03-30T05:12:00.070 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: jq '.acting | .[]' 2021-03-30T05:12:00.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:963: get_osds: local 'osds=1 2021-03-30T05:12:00.437 INFO:tasks.workunit.client.0.smithi197.stderr:0' 2021-03-30T05:12:00.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:965: get_osds: echo 1 0 2021-03-30T05:12:00.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: test_get_osds: teardown td/ceph-helpers 2021-03-30T05:12:00.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:00.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:00.438 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:00.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:00.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:00.438 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:00.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:00.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:00.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:00.542 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:00.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:00.543 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:00.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:00.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:00.545 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:00.546 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:00.546 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:00.546 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:00.547 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:00.547 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:00.548 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:00.548 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:00.552 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:00.552 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:00.552 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:00.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:00.554 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:00.554 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:00.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:12:00.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_pg td/ceph-helpers 2021-03-30T05:12:00.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1038: test_get_pg: local dir=td/ceph-helpers 2021-03-30T05:12:00.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1040: test_get_pg: setup td/ceph-helpers 2021-03-30T05:12:00.555 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:12:00.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:12:00.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:00.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:00.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:00.556 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:00.557 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:00.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:00.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:00.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:00.559 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:00.559 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:00.559 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:00.560 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:00.560 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:00.560 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:00.560 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:00.560 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:00.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:00.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:00.561 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:00.562 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:00.563 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:00.563 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:00.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:00.563 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:00.564 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:00.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:00.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:00.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:00.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:12:00.566 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:12:00.566 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:00.567 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:00.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:12:00.567 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:12:00.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:12:00.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:12:00.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:12:00.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1041: test_get_pg: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:12:00.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:12:00.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:12:00.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:12:00.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:12:00.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:12:00.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:12:00.864 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:12:00.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:00.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:00.865 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:00.865 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:00.865 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:00.866 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:00.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:12:01.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:12:01.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:12:01.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:01.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:01.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:12:01.018 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:12:01.018 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:01.018 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:01.018 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:01.018 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:01.018 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:01.019 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:01.019 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:01.019 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:01.020 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:12:01.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:12:01.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:01.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:01.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:12:01.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:12:01.105 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:01.105 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:01.106 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:01.106 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:01.106 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:01.106 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:01.106 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:01.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:01.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:12:01.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1042: test_get_pg: run_mgr td/ceph-helpers x 2021-03-30T05:12:01.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:12:01.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:12:01.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:12:01.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:12:01.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:12:01.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:12:02.072 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:12:02.072 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:02.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:02.073 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:02.073 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:02.073 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:02.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:02.074 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:02.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:02.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1043: test_get_pg: run_osd td/ceph-helpers 0 2021-03-30T05:12:02.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:12:02.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:12:02.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:12:02.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:12:02.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:12:02.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:12:02.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:12:02.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:12:02.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:12:02.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:12:02.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:12:02.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:12:02.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:12:02.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:12:02.100 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:12:02.101 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:02.101 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:02.101 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:02.102 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:02.102 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:02.102 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:02.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:02.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:12:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:12:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:12:02.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:12:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:12:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:12:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:12:02.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:02.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:12:02.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:12:02.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:12:02.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:12:02.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e5f5c187-30da-4a5f-92be-ecc8773089e7 2021-03-30T05:12:02.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 e5f5c187-30da-4a5f-92be-ecc8773089e7' 2021-03-30T05:12:02.106 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 e5f5c187-30da-4a5f-92be-ecc8773089e7 2021-03-30T05:12:02.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:12:02.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAis2JgL7qZBhAA1xEOJESP8Ts3i+rZMeuHGA== 2021-03-30T05:12:02.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAis2JgL7qZBhAA1xEOJESP8Ts3i+rZMeuHGA=="}' 2021-03-30T05:12:02.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e5f5c187-30da-4a5f-92be-ecc8773089e7 -i td/ceph-helpers/0/new.json 2021-03-30T05:12:02.478 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:02.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:12:02.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAis2JgL7qZBhAA1xEOJESP8Ts3i+rZMeuHGA== --osd-uuid e5f5c187-30da-4a5f-92be-ecc8773089e7 2021-03-30T05:12:02.511 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:02.510+0000 7f6b9fb5df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:02.513 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:02.512+0000 7f6b9fb5df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:02.514 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:02.513+0000 7f6b9fb5df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:02.515 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:02.513+0000 7f6b9fb5df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:02.515 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:02.513+0000 7f6b9fb5df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:02.515 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:02.513+0000 7f6b9fb5df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:02.556 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:02.555+0000 7f6b9fb5df40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:12:03.025 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:03.023+0000 7f6b9fb5df40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:12:05.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:12:05.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:12:05.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:12:05.578 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:12:05.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:12:05.825 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:12:05.826 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:12:05.826 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:05.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:12:05.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:12:05.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:12:05.846 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:05.844+0000 7f1f59bfcf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:05.847 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:05.846+0000 7f1f59bfcf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:05.849 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:05.847+0000 7f1f59bfcf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:06.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:12:06.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:12:06.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:12:06.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:12:06.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:12:06.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:06.212 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:06.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:12:06.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:06.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:06.367 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:06.367+0000 7f1f59bfcf40 -1 Falling back to public interface 2021-03-30T05:12:06.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:12:07.114 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:07.114+0000 7f1f59bfcf40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:12:07.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:12:07.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:07.570 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:12:07.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:12:07.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:07.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:07.973 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/56072,v1:127.0.0.1:6803/56072] [v2:127.0.0.1:6804/56072,v1:127.0.0.1:6805/56072] exists,up e5f5c187-30da-4a5f-92be-ecc8773089e7 2021-03-30T05:12:07.974 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:12:07.974 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:12:07.975 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:12:07.975 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1044: test_get_pg: create_rbd_pool 2021-03-30T05:12:07.975 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:12:08.375 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:12:08.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:12:08.384 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:12:08.945 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:12:08.953 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:12:09.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:12:10.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1045: test_get_pg: wait_for_clean 2021-03-30T05:12:10.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:12:10.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:12:10.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:12:10.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:12:10.885 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:12:10.886 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:10.886 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:10.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:10.887 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:10.887 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:10.984 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:12:10.984 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:12:10.984 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:12:10.984 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:12:10.984 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:12:11.387 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:12:11.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:12:11.388 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:12:11.388 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:12:11.510 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:12:11.511 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:12:11.511 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:12:11.511 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:12:11.512 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:12:11.512 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:12:11.512 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:12:11.513 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:12:11.514 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:12:11.514 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:12:11.514 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:12:11.514 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:12:11.515 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:12:11.870 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:12:11.870 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:12:11.870 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:12:11.870 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:12:12.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:12:12.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:12:12.361 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:12:12.361 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:12:12.361 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:12:12.361 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:12:12.362 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:12:12.362 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:12:12.701 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:12:12.701 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:12:12.701 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:12:12.702 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:12:13.162 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:12:13.162 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:12:13.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:12:13.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: test_get_pg: get_pg rbd GROUP 2021-03-30T05:12:13.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1031: get_pg: local poolname=rbd 2021-03-30T05:12:13.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1032: get_pg: local objectname=GROUP 2021-03-30T05:12:13.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1046: test_get_pg: grep --quiet '^[0-9]\.[0-9a-f][0-9a-f]*$' 2021-03-30T05:12:13.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: ceph --format json osd map rbd GROUP 2021-03-30T05:12:13.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1034: get_pg: jq -r .pgid 2021-03-30T05:12:13.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1047: test_get_pg: teardown td/ceph-helpers 2021-03-30T05:12:13.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:13.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:13.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:13.527 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:13.527 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:13.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:13.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:13.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:13.631 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:13.632 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:13.632 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:13.633 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:13.633 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:13.634 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:13.634 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:13.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:13.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:13.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:13.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:13.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:13.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:13.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:13.640 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:13.640 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:13.640 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:13.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:13.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:13.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:13.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:12:13.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_primary td/ceph-helpers 2021-03-30T05:12:13.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1142: test_get_primary: local dir=td/ceph-helpers 2021-03-30T05:12:13.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1144: test_get_primary: setup td/ceph-helpers 2021-03-30T05:12:13.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:12:13.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:12:13.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:13.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:13.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:13.645 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:13.645 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:13.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:13.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:13.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:13.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:13.647 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:13.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:13.647 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:13.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:13.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:13.648 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:13.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:13.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:13.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:13.649 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:13.650 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:13.650 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:13.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:13.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:13.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:13.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:13.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:13.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:13.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:13.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:12:13.654 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:12:13.654 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:13.654 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:13.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:12:13.655 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:12:13.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:12:13.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:12:13.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:12:13.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1145: test_get_primary: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:12:13.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:12:13.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:12:13.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:12:13.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:12:13.656 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:12:13.657 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:12:13.981 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:12:13.981 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:13.981 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:13.982 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:13.982 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:13.982 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:13.982 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:13.982 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:12:14.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:12:14.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:12:14.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:14.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:14.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:12:14.185 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:12:14.185 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:14.185 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:14.185 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:14.185 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:14.186 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:14.186 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:14.186 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:14.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:14.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:12:14.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:12:14.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:14.273 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:14.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:12:14.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:12:14.274 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:14.274 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:14.274 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:14.275 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:14.275 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:14.275 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:14.275 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:14.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:14.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:12:14.359 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1146: test_get_primary: local osd=0 2021-03-30T05:12:14.359 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1147: test_get_primary: run_mgr td/ceph-helpers x 2021-03-30T05:12:14.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:12:14.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:12:14.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:12:14.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:12:14.360 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:12:14.361 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:12:15.238 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:12:15.239 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:15.239 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:15.239 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:15.239 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:15.240 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:15.240 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:15.240 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:15.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:15.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1148: test_get_primary: run_osd td/ceph-helpers 0 2021-03-30T05:12:15.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:12:15.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:12:15.264 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:12:15.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:12:15.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:12:15.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:12:15.265 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:12:15.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:12:15.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:12:15.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:12:15.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:12:15.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:12:15.267 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:12:15.267 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:12:15.267 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:12:15.267 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:15.268 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:15.268 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:15.268 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:15.268 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:15.268 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:12:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:12:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:12:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:12:15.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:12:15.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:12:15.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:12:15.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:15.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:12:15.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:12:15.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:12:15.271 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:12:15.271 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=72c3bbbb-5be7-405b-8137-7c3467ab7ca6 2021-03-30T05:12:15.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 72c3bbbb-5be7-405b-8137-7c3467ab7ca6' 2021-03-30T05:12:15.272 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 72c3bbbb-5be7-405b-8137-7c3467ab7ca6 2021-03-30T05:12:15.272 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:12:15.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAvs2JgRVaLEBAACbZEBOSBRggPEHeH8+XOww== 2021-03-30T05:12:15.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAvs2JgRVaLEBAACbZEBOSBRggPEHeH8+XOww=="}' 2021-03-30T05:12:15.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 72c3bbbb-5be7-405b-8137-7c3467ab7ca6 -i td/ceph-helpers/0/new.json 2021-03-30T05:12:15.603 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:15.612 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:12:15.613 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAvs2JgRVaLEBAACbZEBOSBRggPEHeH8+XOww== --osd-uuid 72c3bbbb-5be7-405b-8137-7c3467ab7ca6 2021-03-30T05:12:15.635 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:15.635+0000 7f328a3b4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:15.637 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:15.637+0000 7f328a3b4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:15.638 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:15.638+0000 7f328a3b4f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:15.639 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:15.638+0000 7f328a3b4f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:15.639 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:15.638+0000 7f328a3b4f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:15.640 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:15.638+0000 7f328a3b4f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:15.690 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:15.689+0000 7f328a3b4f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:12:16.125 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:16.124+0000 7f328a3b4f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:12:18.768 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:12:18.769 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:12:18.769 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:12:18.770 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:12:18.770 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:12:19.252 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:12:19.252 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:12:19.253 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:19.253 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:12:19.253 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:12:19.254 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:12:19.272 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:19.272+0000 7f691d087f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:19.274 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:19.274+0000 7f691d087f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:19.276 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:19.275+0000 7f691d087f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:19.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:12:19.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:12:19.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:12:19.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:12:19.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:12:19.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:19.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:12:19.610 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:19.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:19.611 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:19.792 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:19.791+0000 7f691d087f40 -1 Falling back to public interface 2021-03-30T05:12:19.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:12:20.565 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:20.564+0000 7f691d087f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:12:20.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:12:20.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:20.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:12:20.966 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:12:20.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:20.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:21.330 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/57078,v1:127.0.0.1:6803/57078] [v2:127.0.0.1:6804/57078,v1:127.0.0.1:6805/57078] exists,up 72c3bbbb-5be7-405b-8137-7c3467ab7ca6 2021-03-30T05:12:21.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:12:21.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:12:21.332 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:12:21.332 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1149: test_get_primary: create_rbd_pool 2021-03-30T05:12:21.332 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:12:21.787 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:12:21.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:12:21.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:12:22.402 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:12:22.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:12:23.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:12:24.451 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1150: test_get_primary: wait_for_clean 2021-03-30T05:12:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:12:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:12:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:12:24.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:12:24.453 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:12:24.453 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:24.453 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:24.453 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:24.453 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:24.453 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:24.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:12:24.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:12:24.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:12:24.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:12:24.552 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:12:24.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:12:24.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:12:24.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:12:24.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:12:25.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:12:25.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:12:25.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:12:25.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:12:25.035 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:12:25.035 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:12:25.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:12:25.036 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:12:25.036 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:12:25.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:12:25.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:12:25.037 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:12:25.038 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:12:25.386 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:12:25.386 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:12:26.387 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:12:26.388 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:12:26.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:12:26.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:12:27.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:12:27.761 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:12:28.120 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:12:28.121 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:12:28.121 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:12:28.121 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:12:28.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:12:28.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:12:28.610 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:12:28.610 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:12:28.610 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:12:28.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:12:28.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:12:28.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:12:28.952 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:12:28.952 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:12:28.953 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:12:28.953 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:12:29.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:12:29.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:12:29.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:12:29.430 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1151: test_get_primary: get_primary rbd GROUP 2021-03-30T05:12:29.430 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1134: get_primary: local poolname=rbd 2021-03-30T05:12:29.430 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1135: get_primary: local objectname=GROUP 2021-03-30T05:12:29.430 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1137: get_primary: ceph --format json osd map rbd GROUP 2021-03-30T05:12:29.431 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1138: get_primary: jq .acting_primary 2021-03-30T05:12:29.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1151: test_get_primary: test 0 = 0 2021-03-30T05:12:29.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: test_get_primary: teardown td/ceph-helpers 2021-03-30T05:12:29.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:29.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:29.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:29.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:29.798 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:29.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:29.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:29.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:29.901 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:29.901 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:29.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:29.902 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:29.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:29.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:29.904 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:29.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:29.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:29.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:29.906 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:29.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:29.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:29.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:29.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:29.910 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:29.910 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:29.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:29.912 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:29.912 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:29.912 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:12:29.912 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_get_timeout_delays td/ceph-helpers 2021-03-30T05:12:29.913 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1554: test_get_timeout_delays: get_timeout_delays 1 2021-03-30T05:12:29.913 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:29.913 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:29.913 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:29.913 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:29.914 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:29.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1554: test_get_timeout_delays: test '1 ' = '1 ' 2021-03-30T05:12:29.922 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1555: test_get_timeout_delays: get_timeout_delays 5 2021-03-30T05:12:29.923 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:29.923 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:29.923 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:29.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:29.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:29.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1555: test_get_timeout_delays: test '1 2 2 ' = '1 2 2 ' 2021-03-30T05:12:29.942 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1556: test_get_timeout_delays: get_timeout_delays 6 2021-03-30T05:12:29.942 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:29.943 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:29.943 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:29.943 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:29.943 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:29.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1556: test_get_timeout_delays: test '1 2 3 ' = '1 2 3 ' 2021-03-30T05:12:29.961 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1557: test_get_timeout_delays: get_timeout_delays 7 2021-03-30T05:12:29.962 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:29.962 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:29.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:29.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:29.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:29.985 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1557: test_get_timeout_delays: test '1 2 4 ' = '1 2 4 ' 2021-03-30T05:12:29.985 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1558: test_get_timeout_delays: get_timeout_delays 8 2021-03-30T05:12:29.986 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:29.986 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:29.987 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:29.987 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:29.987 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.011 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1558: test_get_timeout_delays: test '1 2 4 1 ' = '1 2 4 1 ' 2021-03-30T05:12:30.012 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1559: test_get_timeout_delays: get_timeout_delays 1 .1 2021-03-30T05:12:30.012 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.013 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.013 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1559: test_get_timeout_delays: test '0.1 0.2 0.4 0.3 ' = '0.1 0.2 0.4 0.3 ' 2021-03-30T05:12:30.038 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1560: test_get_timeout_delays: get_timeout_delays 1.5 .1 2021-03-30T05:12:30.039 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.039 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.039 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.039 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.040 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1560: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 ' = '0.1 0.2 0.4 0.8 ' 2021-03-30T05:12:30.069 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1561: test_get_timeout_delays: get_timeout_delays 5 .1 2021-03-30T05:12:30.070 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.070 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.109 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1561: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 1.9 ' = '0.1 0.2 0.4 0.8 1.6 1.9 ' 2021-03-30T05:12:30.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1562: test_get_timeout_delays: get_timeout_delays 6 .1 2021-03-30T05:12:30.110 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.111 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.149 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1562: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 2.9 ' = '0.1 0.2 0.4 0.8 1.6 2.9 ' 2021-03-30T05:12:30.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1563: test_get_timeout_delays: get_timeout_delays 6.3 .1 2021-03-30T05:12:30.150 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.150 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.150 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.151 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.151 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.188 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1563: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 ' = '0.1 0.2 0.4 0.8 1.6 3.2 ' 2021-03-30T05:12:30.189 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1564: test_get_timeout_delays: get_timeout_delays 20 .1 2021-03-30T05:12:30.190 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.190 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.190 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.190 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.190 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1564: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 7.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 7.3 ' 2021-03-30T05:12:30.242 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1565: test_get_timeout_delays: get_timeout_delays 300 .1 0 2021-03-30T05:12:30.242 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.243 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.243 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.243 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.243 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1565: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 12.8 25.6 51.2 102.4 95.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 12.8 25.6 51.2 102.4 95.3 ' 2021-03-30T05:12:30.321 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1566: test_get_timeout_delays: get_timeout_delays 300 .1 10 2021-03-30T05:12:30.322 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:30.322 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:30.322 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:30.323 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:30.323 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:30.563 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1566: test_get_timeout_delays: test '0.1 0.2 0.4 0.8 1.6 3.2 6.4 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 7.3 ' = '0.1 0.2 0.4 0.8 1.6 3.2 6.4 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 7.3 ' 2021-03-30T05:12:30.563 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:12:30.563 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_is_clean td/ceph-helpers 2021-03-30T05:12:30.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1499: test_is_clean: local dir=td/ceph-helpers 2021-03-30T05:12:30.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1501: test_is_clean: setup td/ceph-helpers 2021-03-30T05:12:30.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:12:30.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:12:30.565 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:30.565 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:30.565 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:30.565 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:30.566 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:30.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:30.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:30.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:30.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:30.568 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:30.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:30.569 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:30.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:30.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:30.569 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:30.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:30.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:30.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:30.570 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:30.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:30.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:30.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:30.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:30.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:30.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:30.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:30.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:30.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:30.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:12:30.575 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:12:30.575 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:30.575 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:30.575 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:12:30.577 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:12:30.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:12:30.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:12:30.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:12:30.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1502: test_is_clean: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:12:30.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:12:30.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:12:30.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:12:30.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:12:30.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:12:30.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:12:30.917 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:12:30.917 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:30.917 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:30.917 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:30.918 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:30.918 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:30.918 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:30.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:12:31.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:12:31.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:12:31.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:31.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:31.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:12:31.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:12:31.128 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:31.128 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:31.129 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:31.129 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:31.129 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:31.129 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:31.130 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:31.130 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:31.130 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:12:31.214 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:12:31.214 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:31.215 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:31.215 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:12:31.215 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:12:31.215 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:31.216 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:31.216 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:31.216 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:31.216 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:31.216 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:31.217 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:31.217 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:31.217 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:12:31.303 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1503: test_is_clean: run_mgr td/ceph-helpers x 2021-03-30T05:12:31.303 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:12:31.303 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:12:31.303 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:12:31.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:12:31.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:12:31.304 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:12:32.181 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:12:32.181 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:32.182 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:32.182 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:32.182 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:32.182 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:32.183 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:32.183 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:32.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:32.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1504: test_is_clean: run_osd td/ceph-helpers 0 2021-03-30T05:12:32.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:12:32.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:12:32.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:12:32.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:12:32.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:12:32.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:12:32.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:12:32.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:12:32.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:12:32.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:12:32.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:12:32.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:12:32.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:12:32.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:12:32.209 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:12:32.209 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:32.209 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:32.210 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:32.210 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:32.210 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:32.210 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:32.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:32.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:12:32.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:12:32.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:12:32.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:12:32.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:12:32.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:12:32.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:12:32.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:32.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:12:32.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:12:32.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:12:32.213 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:12:32.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=95671a8c-e9c0-4f71-9c47-e06a763a2f73 2021-03-30T05:12:32.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 95671a8c-e9c0-4f71-9c47-e06a763a2f73' 2021-03-30T05:12:32.214 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 95671a8c-e9c0-4f71-9c47-e06a763a2f73 2021-03-30T05:12:32.214 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:12:32.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBAs2Jg/0gdDRAAHG3sYNnt+Do9NGgEdKaCmA== 2021-03-30T05:12:32.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBAs2Jg/0gdDRAAHG3sYNnt+Do9NGgEdKaCmA=="}' 2021-03-30T05:12:32.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 95671a8c-e9c0-4f71-9c47-e06a763a2f73 -i td/ceph-helpers/0/new.json 2021-03-30T05:12:32.539 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:32.548 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:12:32.549 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBAs2Jg/0gdDRAAHG3sYNnt+Do9NGgEdKaCmA== --osd-uuid 95671a8c-e9c0-4f71-9c47-e06a763a2f73 2021-03-30T05:12:32.571 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:32.571+0000 7fd5f3727f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:32.573 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:32.573+0000 7fd5f3727f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:32.574 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:32.574+0000 7fd5f3727f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:32.575 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:32.575+0000 7fd5f3727f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:32.575 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:32.575+0000 7fd5f3727f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:32.576 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:32.575+0000 7fd5f3727f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:32.616 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:32.616+0000 7fd5f3727f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:12:33.011 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:33.010+0000 7fd5f3727f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:12:35.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:12:35.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:12:35.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:12:35.704 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:12:35.705 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:12:36.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:12:36.187 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:12:36.188 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:36.188 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:12:36.188 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:12:36.188 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:12:36.207 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:36.205+0000 7f89225fdf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:36.209 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:36.207+0000 7f89225fdf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:36.210 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:36.208+0000 7f89225fdf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:36.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:12:36.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:12:36.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:12:36.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:12:36.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:12:36.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:36.542 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:36.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:12:36.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:36.544 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:36.725 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:36.724+0000 7f89225fdf40 -1 Falling back to public interface 2021-03-30T05:12:36.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:12:37.492 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:37.490+0000 7f89225fdf40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:12:37.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:12:37.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:37.898 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:12:37.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:12:37.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:37.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:38.266 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/58915,v1:127.0.0.1:6803/58915] [v2:127.0.0.1:6804/58915,v1:127.0.0.1:6805/58915] exists,up 95671a8c-e9c0-4f71-9c47-e06a763a2f73 2021-03-30T05:12:38.267 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:12:38.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:12:38.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:12:38.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1505: test_is_clean: create_rbd_pool 2021-03-30T05:12:38.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:12:38.643 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:12:38.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:12:38.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:12:39.196 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:12:39.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:12:40.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:12:41.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1506: test_is_clean: wait_for_clean 2021-03-30T05:12:41.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:12:41.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:12:41.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:12:41.186 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:12:41.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:12:41.187 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:12:41.187 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:12:41.188 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:12:41.188 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:12:41.188 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:12:41.284 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:12:41.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:12:41.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:12:41.285 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:12:41.285 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:12:41.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:12:41.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:12:41.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:12:41.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:12:41.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836484 2021-03-30T05:12:41.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836484 2021-03-30T05:12:41.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836484' 2021-03-30T05:12:41.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:12:41.792 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836484 2021-03-30T05:12:41.792 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:12:41.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:12:41.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836484 2021-03-30T05:12:41.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:12:41.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836484 2021-03-30T05:12:41.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2021-03-30T05:12:41.795 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836484 2021-03-30T05:12:41.795 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:12:42.143 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836482 -lt 21474836484 2021-03-30T05:12:42.143 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:12:43.143 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:12:43.144 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:12:43.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836482 -lt 21474836484 2021-03-30T05:12:43.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:12:44.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:12:44.505 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:12:44.869 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836484 -lt 21474836484 2021-03-30T05:12:44.869 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:12:44.870 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:12:44.870 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:12:45.333 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:12:45.333 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:12:45.333 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:12:45.334 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:12:45.334 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:12:45.334 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:12:45.334 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:12:45.335 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:12:45.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:12:45.678 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:12:45.678 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:12:45.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:12:46.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:12:46.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:12:46.155 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:12:46.155 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1507: test_is_clean: is_clean 2021-03-30T05:12:46.155 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1493: is_clean: get_num_pgs 2021-03-30T05:12:46.155 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:12:46.156 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:12:46.615 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1493: is_clean: num_pgs=4 2021-03-30T05:12:46.615 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1494: is_clean: test 4 '!=' 0 2021-03-30T05:12:46.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1495: is_clean: get_num_active_clean 2021-03-30T05:12:46.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:12:46.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:12:46.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:12:46.616 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:12:46.617 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:12:46.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1495: is_clean: test 4 = 4 2021-03-30T05:12:46.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1508: test_is_clean: teardown td/ceph-helpers 2021-03-30T05:12:46.958 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:46.959 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:46.959 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:46.959 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:46.959 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:46.959 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:46.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:46.960 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:47.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:47.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:47.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:47.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:47.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:47.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:47.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:47.066 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:47.067 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:47.067 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:47.067 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:47.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:47.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:47.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:47.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:47.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:47.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:47.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:47.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:47.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:47.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:12:47.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_kill_daemon td/ceph-helpers 2021-03-30T05:12:47.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:275: test_kill_daemon: local dir=td/ceph-helpers 2021-03-30T05:12:47.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:276: test_kill_daemon: setup td/ceph-helpers 2021-03-30T05:12:47.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:12:47.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:12:47.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:12:47.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:12:47.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:12:47.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:12:47.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:12:47.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:12:47.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:12:47.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:12:47.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:12:47.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:12:47.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:12:47.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:12:47.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:12:47.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:12:47.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:12:47.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:47.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:12:47.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:12:47.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:12:47.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:12:47.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:12:47.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:12:47.085 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:12:47.085 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:47.085 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:47.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:12:47.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:12:47.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:12:47.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:12:47.086 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:12:47.086 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:47.087 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:47.087 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:12:47.087 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:12:47.087 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:12:47.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:12:47.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:12:47.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:277: test_kill_daemon: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:12:47.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:12:47.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:12:47.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:12:47.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:12:47.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:12:47.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:12:47.426 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:12:47.426 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:47.427 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:47.427 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:47.427 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:47.428 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:47.428 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:47.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:12:47.610 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:12:47.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:12:47.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:47.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:47.612 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:12:47.613 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:12:47.613 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:47.613 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:47.613 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:47.613 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:47.614 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:47.614 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:47.614 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:47.614 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:47.614 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:12:47.698 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:12:47.698 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:12:47.699 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:12:47.699 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:12:47.699 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:12:47.699 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:12:47.699 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:12:47.700 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:12:47.700 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:12:47.700 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:47.700 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:47.700 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:12:47.701 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:12:47.701 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:12:47.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:278: test_kill_daemon: run_mgr td/ceph-helpers x 2021-03-30T05:12:47.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:12:47.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:12:47.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:12:47.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:12:47.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:12:47.786 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:12:48.299 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:12:48.300 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:48.300 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:48.300 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:48.300 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:48.301 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:48.301 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:48.301 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:48.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:12:48.324 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:279: test_kill_daemon: run_osd td/ceph-helpers 0 2021-03-30T05:12:48.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:12:48.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:12:48.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:12:48.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:12:48.325 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:12:48.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:12:48.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:12:48.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:12:48.326 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:12:48.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:12:48.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:12:48.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:12:48.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:12:48.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:12:48.328 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:12:48.328 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:12:48.328 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:12:48.328 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:12:48.329 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:12:48.329 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:12:48.329 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:48.329 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:12:48.329 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:12:48.330 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:12:48.330 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:12:48.330 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:12:48.330 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:12:48.330 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:12:48.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:12:48.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:48.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:12:48.331 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:12:48.332 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:12:48.332 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:12:48.332 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=99639409-c119-44fd-b62e-1ed995264d1f 2021-03-30T05:12:48.332 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 99639409-c119-44fd-b62e-1ed995264d1f' 2021-03-30T05:12:48.333 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 99639409-c119-44fd-b62e-1ed995264d1f 2021-03-30T05:12:48.333 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:12:48.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBQs2Jg174qFBAA0Pu2iE5MqLnQudWUFy3ivw== 2021-03-30T05:12:48.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBQs2Jg174qFBAA0Pu2iE5MqLnQudWUFy3ivw=="}' 2021-03-30T05:12:48.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 99639409-c119-44fd-b62e-1ed995264d1f -i td/ceph-helpers/0/new.json 2021-03-30T05:12:48.672 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:48.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:12:48.683 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBQs2Jg174qFBAA0Pu2iE5MqLnQudWUFy3ivw== --osd-uuid 99639409-c119-44fd-b62e-1ed995264d1f 2021-03-30T05:12:48.705 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:48.703+0000 7f4c4032af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:48.707 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:48.705+0000 7f4c4032af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:48.708 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:48.706+0000 7f4c4032af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:48.708 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:48.707+0000 7f4c4032af40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:48.708 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:48.707+0000 7f4c4032af40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:48.709 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:48.707+0000 7f4c4032af40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:12:48.794 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:48.793+0000 7f4c4032af40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:12:49.187 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:49.185+0000 7f4c4032af40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:12:51.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:12:51.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:12:51.865 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:12:51.865 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:12:51.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:12:52.348 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:12:52.349 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:12:52.349 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:12:52.350 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:12:52.350 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:12:52.350 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:12:52.368 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:52.367+0000 7fe39b599f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:52.370 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:52.369+0000 7fe39b599f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:52.372 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:52.370+0000 7fe39b599f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:12:52.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:12:52.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:12:52.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:12:52.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:12:52.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:12:52.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:52.792 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:12:52.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:12:52.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:52.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:52.896 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:52.895+0000 7fe39b599f40 -1 Falling back to public interface 2021-03-30T05:12:53.144 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:12:53.661 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:12:53.659+0000 7fe39b599f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:12:54.146 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:12:54.146 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:12:54.146 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:12:54.147 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:12:54.147 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:12:54.147 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:12:54.527 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/59994,v1:127.0.0.1:6803/59994] [v2:127.0.0.1:6804/59994,v1:127.0.0.1:6805/59994] exists,up 99639409-c119-44fd-b62e-1ed995264d1f 2021-03-30T05:12:54.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:12:54.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:12:54.529 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:12:54.529 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:281: test_kill_daemon: name_prefix=osd 2021-03-30T05:12:54.529 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:282: test_kill_daemon: find td/ceph-helpers 2021-03-30T05:12:54.529 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:282: test_kill_daemon: grep 'osd[^/]*\.pid' 2021-03-30T05:12:54.531 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:282: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2021-03-30T05:12:54.531 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:289: test_kill_daemon: kill_daemon td/ceph-helpers/osd.0.pid 0 1 2021-03-30T05:12:54.531 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/osd.0.pid 2021-03-30T05:12:54.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=59994 2021-03-30T05:12:54.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=0 2021-03-30T05:12:54.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local delays=1 2021-03-30T05:12:54.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2021-03-30T05:12:54.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:54.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 59994 2021-03-30T05:12:54.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2021-03-30T05:12:54.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-03-30T05:12:54.533 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 1 2021-03-30T05:12:55.531 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:55.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 59994 2021-03-30T05:12:55.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2021-03-30T05:12:55.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-03-30T05:12:55.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0 2021-03-30T05:12:55.534 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 1 2021-03-30T05:12:55.534 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:293: test_kill_daemon: kill_daemon td/ceph-helpers/osd.0.pid TERM 2021-03-30T05:12:55.534 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/osd.0.pid 2021-03-30T05:12:55.534 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=59994 2021-03-30T05:12:55.535 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2021-03-30T05:12:55.535 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2021-03-30T05:12:55.535 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2021-03-30T05:12:55.535 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:55.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 59994 2021-03-30T05:12:55.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2021-03-30T05:12:55.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-03-30T05:12:55.536 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2021-03-30T05:12:55.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:55.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 59994 2021-03-30T05:12:55.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2021-03-30T05:12:55.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2021-03-30T05:12:55.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2021-03-30T05:12:55.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:296: test_kill_daemon: name_prefix=mgr 2021-03-30T05:12:55.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:297: test_kill_daemon: find td/ceph-helpers 2021-03-30T05:12:55.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:297: test_kill_daemon: grep 'mgr[^/]*\.pid' 2021-03-30T05:12:55.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:297: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2021-03-30T05:12:55.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:301: test_kill_daemon: kill_daemon td/ceph-helpers/mgr.x.pid TERM 2021-03-30T05:12:55.639 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/mgr.x.pid 2021-03-30T05:12:55.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=59714 2021-03-30T05:12:55.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2021-03-30T05:12:55.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2021-03-30T05:12:55.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2021-03-30T05:12:55.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:55.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 59714 2021-03-30T05:12:55.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2021-03-30T05:12:55.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-03-30T05:12:55.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2021-03-30T05:12:55.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:55.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 59714 2021-03-30T05:12:55.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2021-03-30T05:12:55.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2021-03-30T05:12:55.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2021-03-30T05:12:55.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:304: test_kill_daemon: name_prefix=mon 2021-03-30T05:12:55.742 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:305: test_kill_daemon: find td/ceph-helpers 2021-03-30T05:12:55.742 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:305: test_kill_daemon: grep 'mon[^/]*\.pid' 2021-03-30T05:12:55.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:305: test_kill_daemon: for pidfile in $(find $dir 2>/dev/null | grep $name_prefix'[^/]*\.pid') 2021-03-30T05:12:55.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:309: test_kill_daemon: kill_daemon td/ceph-helpers/mon.a.pid TERM 2021-03-30T05:12:55.744 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: cat td/ceph-helpers/mon.a.pid 2021-03-30T05:12:55.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:255: kill_daemon: local pid=59622 2021-03-30T05:12:55.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: local send_signal=TERM 2021-03-30T05:12:55.744 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2021-03-30T05:12:55.745 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:258: kill_daemon: local exit_code=1 2021-03-30T05:12:55.745 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:55.745 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -TERM 59622 2021-03-30T05:12:55.745 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2021-03-30T05:12:55.745 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-03-30T05:12:55.746 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.1 2021-03-30T05:12:55.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:55.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 59622 2021-03-30T05:12:55.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:263: kill_daemon: exit_code=1 2021-03-30T05:12:55.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:268: kill_daemon: send_signal=0 2021-03-30T05:12:55.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:269: kill_daemon: sleep 0.2 2021-03-30T05:12:56.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:261: kill_daemon: for try in $delays 0 2021-03-30T05:12:56.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: kill -0 59622 2021-03-30T05:12:56.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:265: kill_daemon: exit_code=0 2021-03-30T05:12:56.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:266: kill_daemon: break 2021-03-30T05:12:56.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:271: kill_daemon: return 0 2021-03-30T05:12:56.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:310: test_kill_daemon: timeout 5 ceph status 2021-03-30T05:13:01.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:313: test_kill_daemon: teardown td/ceph-helpers 2021-03-30T05:13:01.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:13:01.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:13:01.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:13:01.050 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:01.050 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:01.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:01.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:01.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:01.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:01.054 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:13:01.054 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:13:01.055 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:13:01.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:13:01.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:13:01.056 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:13:01.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:01.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:13:01.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:13:01.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:01.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:13:01.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:13:01.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:13:01.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:13:01.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:01.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:01.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:13:01.066 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:13:01.067 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:13:01.067 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:13:01.067 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_kill_daemons td/ceph-helpers 2021-03-30T05:13:01.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:366: test_kill_daemons: local dir=td/ceph-helpers 2021-03-30T05:13:01.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:367: test_kill_daemons: setup td/ceph-helpers 2021-03-30T05:13:01.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:13:01.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:13:01.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:13:01.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:13:01.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:13:01.069 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:01.070 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:01.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:01.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:01.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:01.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:01.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:13:01.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:13:01.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:13:01.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:13:01.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:13:01.074 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:13:01.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:01.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:13:01.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:13:01.075 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:01.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:13:01.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:13:01.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:13:01.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:13:01.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:01.078 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:01.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:13:01.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:13:01.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:13:01.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:13:01.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:13:01.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:01.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:01.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:13:01.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:13:01.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:13:01.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:13:01.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:13:01.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:368: test_kill_daemons: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:13:01.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:13:01.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:13:01.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:13:01.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:13:01.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:13:01.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:13:01.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:13:01.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:01.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:01.384 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:01.384 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:01.384 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:01.384 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:01.384 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:13:01.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:13:01.543 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:13:01.543 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:13:01.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:13:01.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:13:01.544 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:13:01.544 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:13:01.545 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:13:01.545 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:13:01.545 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:13:01.545 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:01.545 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:01.545 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:13:01.546 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:13:01.546 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:13:01.635 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:13:01.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:13:01.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:13:01.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:13:01.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:13:01.637 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:13:01.637 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:13:01.637 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:13:01.637 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:13:01.637 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:01.638 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:01.638 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:13:01.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:13:01.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:13:01.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:369: test_kill_daemons: run_mgr td/ceph-helpers x 2021-03-30T05:13:01.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:13:01.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:13:01.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:13:01.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:13:01.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:13:01.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:13:02.205 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:13:02.205 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:02.205 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:02.206 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:02.206 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:02.206 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:02.206 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:02.206 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:13:02.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:13:02.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:370: test_kill_daemons: run_osd td/ceph-helpers 0 2021-03-30T05:13:02.230 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:13:02.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:13:02.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:13:02.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:13:02.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:13:02.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:13:02.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:13:02.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:13:02.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:13:02.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:13:02.232 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:13:02.233 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:13:02.233 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:13:02.233 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:13:02.233 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:13:02.233 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:02.234 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:02.234 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:02.234 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:02.234 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:02.234 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:02.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:02.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:13:02.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:13:02.235 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:13:02.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:13:02.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:13:02.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:13:02.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:13:02.236 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:02.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:13:02.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:13:02.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:13:02.237 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:13:02.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=016f3eb2-41a4-4f6c-ae79-65e9e45f27a2 2021-03-30T05:13:02.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 016f3eb2-41a4-4f6c-ae79-65e9e45f27a2' 2021-03-30T05:13:02.238 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 016f3eb2-41a4-4f6c-ae79-65e9e45f27a2 2021-03-30T05:13:02.238 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:13:02.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBes2JgVomJDhAA2mTLszInUhxgSglxZ3srGg== 2021-03-30T05:13:02.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBes2JgVomJDhAA2mTLszInUhxgSglxZ3srGg=="}' 2021-03-30T05:13:02.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 016f3eb2-41a4-4f6c-ae79-65e9e45f27a2 -i td/ceph-helpers/0/new.json 2021-03-30T05:13:02.553 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:13:02.563 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:13:02.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBes2JgVomJDhAA2mTLszInUhxgSglxZ3srGg== --osd-uuid 016f3eb2-41a4-4f6c-ae79-65e9e45f27a2 2021-03-30T05:13:02.586 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:02.586+0000 7f44c58a8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:02.588 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:02.588+0000 7f44c58a8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:02.589 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:02.589+0000 7f44c58a8f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:02.591 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:02.590+0000 7f44c58a8f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:02.591 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:02.590+0000 7f44c58a8f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:02.591 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:02.590+0000 7f44c58a8f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:02.641 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:02.640+0000 7f44c58a8f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:13:03.035 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:03.034+0000 7f44c58a8f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:13:05.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:13:05.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:13:05.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:13:05.740 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:13:05.740 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:13:06.008 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:13:06.008 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:13:06.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:06.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:13:06.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:13:06.009 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:13:06.028 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:06.028+0000 7f7dbbb6bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:06.030 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:06.029+0000 7f7dbbb6bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:06.031 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:06.031+0000 7f7dbbb6bf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:06.378 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:13:06.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:13:06.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:13:06.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:13:06.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:13:06.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:13:06.381 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:13:06.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:13:06.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:13:06.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:13:06.548 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:06.548+0000 7f7dbbb6bf40 -1 Falling back to public interface 2021-03-30T05:13:06.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:13:07.258 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:07.258+0000 7f7dbbb6bf40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:13:07.735 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:13:07.735 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:13:07.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:13:07.736 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:13:07.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:13:07.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:13:08.176 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/60642,v1:127.0.0.1:6803/60642] [v2:127.0.0.1:6804/60642,v1:127.0.0.1:6805/60642] exists,up 016f3eb2-41a4-4f6c-ae79-65e9e45f27a2 2021-03-30T05:13:08.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:13:08.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:13:08.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:13:08.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:377: test_kill_daemons: kill_daemons td/ceph-helpers 0 osd 1 2021-03-30T05:13:08.180 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:08.180 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:08.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:08.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:08.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:09.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 1 2021-03-30T05:13:09.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:381: test_kill_daemons: kill_daemons td/ceph-helpers TERM osd 2021-03-30T05:13:09.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:09.184 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:09.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:09.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:09.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:09.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:09.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:385: test_kill_daemons: kill_daemons td/ceph-helpers TERM mgr 2021-03-30T05:13:09.290 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:09.291 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:09.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:09.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:09.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:09.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:09.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:389: test_kill_daemons: kill_daemons td/ceph-helpers TERM 2021-03-30T05:13:09.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:09.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:09.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:09.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:09.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:09.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:09.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:390: test_kill_daemons: timeout 5 ceph status 2021-03-30T05:13:14.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:391: test_kill_daemons: teardown td/ceph-helpers 2021-03-30T05:13:14.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:13:14.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:13:14.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:13:14.708 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:14.708 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:14.708 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:14.709 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:14.709 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:14.711 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:14.712 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:13:14.712 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:13:14.713 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:13:14.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:13:14.714 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:13:14.714 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:13:14.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:14.716 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:13:14.717 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:13:14.717 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:14.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:13:14.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:13:14.718 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:13:14.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:13:14.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:14.721 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:14.722 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:13:14.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:13:14.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:13:14.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:13:14.724 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_objectstore_tool td/ceph-helpers 2021-03-30T05:13:14.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1245: test_objectstore_tool: local dir=td/ceph-helpers 2021-03-30T05:13:14.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1247: test_objectstore_tool: setup td/ceph-helpers 2021-03-30T05:13:14.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:13:14.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:13:14.725 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:13:14.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:13:14.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:13:14.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:14.726 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:14.726 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:14.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:14.727 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:14.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:14.728 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:13:14.728 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:13:14.729 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:13:14.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:13:14.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:13:14.729 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:13:14.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:14.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:13:14.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:13:14.731 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:14.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:13:14.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:13:14.732 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:13:14.733 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:13:14.733 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:14.733 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:14.733 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:13:14.734 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:13:14.734 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:13:14.734 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:13:14.735 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:13:14.735 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:14.735 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:14.736 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:13:14.737 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:13:14.737 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:13:14.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:13:14.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:13:14.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: test_objectstore_tool: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:13:14.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:13:14.738 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:13:14.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:13:14.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:13:14.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:13:14.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:13:15.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:13:15.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:15.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:15.047 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:15.048 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:15.048 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:15.048 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:15.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:13:15.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:13:15.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:13:15.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:13:15.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:13:15.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:13:15.275 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:13:15.276 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:13:15.276 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:13:15.276 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:13:15.276 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:13:15.277 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:15.277 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:15.277 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:13:15.277 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:13:15.277 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:13:15.371 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:13:15.372 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:13:15.372 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:13:15.372 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:13:15.372 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:13:15.373 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:13:15.373 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:13:15.373 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:13:15.373 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:13:15.373 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:15.374 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:15.374 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:13:15.374 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:13:15.375 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:13:15.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: test_objectstore_tool: local osd=0 2021-03-30T05:13:15.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: test_objectstore_tool: run_mgr td/ceph-helpers x 2021-03-30T05:13:15.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:13:15.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:13:15.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:13:15.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:13:15.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:13:15.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:13:15.910 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:13:15.910 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:15.910 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:15.911 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:15.911 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:15.911 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:15.911 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:15.912 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:13:15.912 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:13:15.935 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: test_objectstore_tool: run_osd td/ceph-helpers 0 2021-03-30T05:13:15.935 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:13:15.935 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:13:15.935 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:13:15.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:13:15.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:13:15.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:13:15.936 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:13:15.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:13:15.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:13:15.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:13:15.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:13:15.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:13:15.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:13:15.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:13:15.938 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:13:15.938 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:15.939 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:15.939 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:15.939 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:15.939 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:15.939 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:15.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:15.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:13:15.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:13:15.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:13:15.940 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:13:15.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:13:15.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:13:15.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:13:15.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:15.941 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:13:15.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:13:15.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:13:15.942 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:13:15.943 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=0536f454-9da5-4620-a9f6-ef9c19e9f995 2021-03-30T05:13:15.943 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 0536f454-9da5-4620-a9f6-ef9c19e9f995' 2021-03-30T05:13:15.943 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 0536f454-9da5-4620-a9f6-ef9c19e9f995 2021-03-30T05:13:15.944 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:13:15.950 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQBrs2JgXS6bOBAAJy9Bs3lmjuWdUeAzOiCa+w== 2021-03-30T05:13:15.950 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQBrs2JgXS6bOBAAJy9Bs3lmjuWdUeAzOiCa+w=="}' 2021-03-30T05:13:15.950 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 0536f454-9da5-4620-a9f6-ef9c19e9f995 -i td/ceph-helpers/0/new.json 2021-03-30T05:13:16.268 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:13:16.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:13:16.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBrs2JgXS6bOBAAJy9Bs3lmjuWdUeAzOiCa+w== --osd-uuid 0536f454-9da5-4620-a9f6-ef9c19e9f995 2021-03-30T05:13:16.301 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.300+0000 7f7010602f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:16.302 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.302+0000 7f7010602f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:16.304 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.303+0000 7f7010602f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:16.304 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.304+0000 7f7010602f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:16.305 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.304+0000 7f7010602f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:16.305 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.304+0000 7f7010602f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:16.390 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.390+0000 7f7010602f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:13:16.790 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:16.790+0000 7f7010602f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:13:19.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:13:19.468 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:13:19.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:13:19.469 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:13:19.470 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:13:19.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:13:19.969 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:13:19.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:19.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:13:19.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:13:19.971 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:13:19.989 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:19.989+0000 7f11ffa23f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:19.991 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:19.991+0000 7f11ffa23f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:19.993 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:19.993+0000 7f11ffa23f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:20.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:13:20.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:13:20.327 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:13:20.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:13:20.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:13:20.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:13:20.328 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:13:20.329 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:13:20.329 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:13:20.329 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:13:20.509 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:20.509+0000 7f11ffa23f40 -1 Falling back to public interface 2021-03-30T05:13:20.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:13:21.255 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:21.255+0000 7f11ffa23f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:13:21.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:13:21.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:13:21.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:13:21.680 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:13:21.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:13:21.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:13:22.080 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/61325,v1:127.0.0.1:6803/61325] [v2:127.0.0.1:6804/61325,v1:127.0.0.1:6805/61325] exists,up 0536f454-9da5-4620-a9f6-ef9c19e9f995 2021-03-30T05:13:22.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:13:22.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:13:22.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:13:22.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: test_objectstore_tool: create_rbd_pool 2021-03-30T05:13:22.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:13:22.523 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:13:22.531 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:13:22.532 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:13:23.083 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:13:23.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:13:24.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:13:25.032 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1253: test_objectstore_tool: wait_for_clean 2021-03-30T05:13:25.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:13:25.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:13:25.033 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:13:25.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:13:25.034 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:13:25.034 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:13:25.034 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:13:25.035 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:13:25.035 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:13:25.035 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:13:25.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:13:25.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:13:25.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:13:25.133 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:13:25.133 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:13:25.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:13:25.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:13:25.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:13:25.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:13:25.632 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:13:25.633 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:13:25.633 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:13:25.633 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:13:25.633 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:13:25.634 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:13:25.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:13:25.635 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:13:25.635 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:13:25.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:13:25.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:13:25.636 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:13:25.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:13:25.985 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:13:25.985 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:13:26.986 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:13:26.986 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:13:27.346 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:13:27.346 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:13:28.347 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:13:28.348 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:13:28.705 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:13:28.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:13:28.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:13:28.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:13:29.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:13:29.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:13:29.167 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:13:29.167 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:13:29.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:13:29.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:13:29.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:13:29.168 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:13:29.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:13:29.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:13:29.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:13:29.509 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:13:29.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:13:29.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:13:29.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:13:29.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1254: test_objectstore_tool: rados --pool rbd put GROUP /etc/group 2021-03-30T05:13:30.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: test_objectstore_tool: objectstore_tool td/ceph-helpers 0 GROUP get-bytes 2021-03-30T05:13:30.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: test_objectstore_tool: diff - /etc/group 2021-03-30T05:13:30.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: objectstore_tool: local dir=td/ceph-helpers 2021-03-30T05:13:30.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: objectstore_tool: shift 2021-03-30T05:13:30.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1237: objectstore_tool: local id=0 2021-03-30T05:13:30.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: objectstore_tool: shift 2021-03-30T05:13:30.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1240: objectstore_tool: _objectstore_tool_nowait td/ceph-helpers 0 GROUP get-bytes 2021-03-30T05:13:30.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local dir=td/ceph-helpers 2021-03-30T05:13:30.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2021-03-30T05:13:30.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1209: _objectstore_tool_nowait: local id=0 2021-03-30T05:13:30.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: shift 2021-03-30T05:13:30.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: kill_daemons td/ceph-helpers TERM osd.0 2021-03-30T05:13:30.050 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:30.050 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:30.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:30.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:30.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:30.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:30.152 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1214: _objectstore_tool_nowait: _objectstore_tool_nodown td/ceph-helpers 0 GROUP get-bytes 2021-03-30T05:13:30.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/ceph-helpers 2021-03-30T05:13:30.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2021-03-30T05:13:30.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=0 2021-03-30T05:13:30.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2021-03-30T05:13:30.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/ceph-helpers/0 2021-03-30T05:13:30.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/ceph-helpers/0 GROUP get-bytes 2021-03-30T05:13:31.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1215: _objectstore_tool_nowait: activate_osd td/ceph-helpers 0 2021-03-30T05:13:31.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ceph-helpers 2021-03-30T05:13:31.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2021-03-30T05:13:31.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2021-03-30T05:13:31.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2021-03-30T05:13:31.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:13:31.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:13:31.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:13:31.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:13:31.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:13:31.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:13:31.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:13:31.132 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2021-03-30T05:13:31.133 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2021-03-30T05:13:31.133 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:13:31.133 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2021-03-30T05:13:31.133 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:31.133 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:31.134 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:31.134 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:31.134 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:31.134 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:31.134 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:31.135 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:13:31.135 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:13:31.135 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:13:31.135 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:13:31.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:13:31.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:31.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2021-03-30T05:13:31.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2021-03-30T05:13:31.136 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:13:31.137 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2021-03-30T05:13:31.137 INFO:tasks.workunit.client.0.smithi197.stderr:start osd.0 2021-03-30T05:13:31.137 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:31.137 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ceph-helpers/0/whoami 2021-03-30T05:13:31.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2021-03-30T05:13:31.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2021-03-30T05:13:31.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2021-03-30T05:13:31.139 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2021-03-30T05:13:31.152 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:31.151+0000 7ff183facf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:31.155 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:31.153+0000 7ff183facf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:31.156 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:31.154+0000 7ff183facf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:31.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2021-03-30T05:13:31.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:13:31.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:13:31.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:13:31.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:13:31.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:13:31.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:13:31.495 INFO:tasks.workunit.client.0.smithi197.stderr:0 2021-03-30T05:13:31.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:13:31.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:13:31.671 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:31.670+0000 7ff183facf40 -1 Falling back to public interface 2021-03-30T05:13:31.851 INFO:tasks.workunit.client.0.smithi197.stderr:osd.0 up in weight 1 up_from 5 up_thru 7 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/61325,v1:127.0.0.1:6803/61325] [v2:127.0.0.1:6804/61325,v1:127.0.0.1:6805/61325] exists,up 0536f454-9da5-4620-a9f6-ef9c19e9f995 2021-03-30T05:13:31.851 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:13:31.851 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:13:31.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:13:31.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1241: objectstore_tool: wait_for_clean 2021-03-30T05:13:31.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:13:31.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:13:31.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:13:31.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:13:31.853 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:13:31.853 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:13:31.853 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:13:31.854 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:13:31.854 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:13:31.854 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:13:31.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:13:31.937 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:13:31.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:13:31.938 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:13:31.938 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:13:32.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:13:32.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:13:32.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:13:32.293 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:13:32.588 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:32.587+0000 7ff183facf40 -1 osd.0 13 log_to_monitors {default=true} 2021-03-30T05:13:37.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=68719476739 2021-03-30T05:13:37.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 68719476739 2021-03-30T05:13:37.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-68719476739' 2021-03-30T05:13:37.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:13:37.422 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-68719476739 2021-03-30T05:13:37.422 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:13:37.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:13:37.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-68719476739 2021-03-30T05:13:37.423 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:13:37.424 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=68719476739 2021-03-30T05:13:37.424 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 68719476739' 2021-03-30T05:13:37.425 INFO:tasks.workunit.client.0.smithi197.stderr:waiting osd.0 seq 68719476739 2021-03-30T05:13:37.425 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:13:37.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 68719476739 2021-03-30T05:13:37.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:13:38.778 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:13:38.778 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:13:39.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 1 -lt 68719476739 2021-03-30T05:13:39.138 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:13:40.139 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 299 -eq 0 ']' 2021-03-30T05:13:40.140 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:13:40.501 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 68719476740 -lt 68719476739 2021-03-30T05:13:40.502 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:13:40.502 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:13:40.503 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:13:40.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:13:40.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:13:40.964 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:13:40.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:13:40.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:13:40.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:13:40.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:13:40.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:13:41.305 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:13:41.306 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:13:41.306 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:13:41.306 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:13:41.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:13:41.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:13:41.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:13:41.772 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: test_objectstore_tool: objectstore_tool td/ceph-helpers 0 NOTEXISTS get-bytes 2021-03-30T05:13:41.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1235: objectstore_tool: local dir=td/ceph-helpers 2021-03-30T05:13:41.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1236: objectstore_tool: shift 2021-03-30T05:13:41.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1237: objectstore_tool: local id=0 2021-03-30T05:13:41.773 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1238: objectstore_tool: shift 2021-03-30T05:13:41.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1240: objectstore_tool: _objectstore_tool_nowait td/ceph-helpers 0 NOTEXISTS get-bytes 2021-03-30T05:13:41.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1207: _objectstore_tool_nowait: local dir=td/ceph-helpers 2021-03-30T05:13:41.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1208: _objectstore_tool_nowait: shift 2021-03-30T05:13:41.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1209: _objectstore_tool_nowait: local id=0 2021-03-30T05:13:41.774 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1210: _objectstore_tool_nowait: shift 2021-03-30T05:13:41.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1212: _objectstore_tool_nowait: kill_daemons td/ceph-helpers TERM osd.0 2021-03-30T05:13:41.775 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:41.775 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:41.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:41.775 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:41.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:41.876 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:41.876 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1214: _objectstore_tool_nowait: _objectstore_tool_nodown td/ceph-helpers 0 NOTEXISTS get-bytes 2021-03-30T05:13:41.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1195: _objectstore_tool_nodown: local dir=td/ceph-helpers 2021-03-30T05:13:41.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1196: _objectstore_tool_nodown: shift 2021-03-30T05:13:41.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1197: _objectstore_tool_nodown: local id=0 2021-03-30T05:13:41.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1198: _objectstore_tool_nodown: shift 2021-03-30T05:13:41.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1199: _objectstore_tool_nodown: local osd_data=td/ceph-helpers/0 2021-03-30T05:13:41.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1202: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/ceph-helpers/0 NOTEXISTS get-bytes 2021-03-30T05:13:42.406 INFO:tasks.workunit.client.0.smithi197.stderr:No object id 'NOTEXISTS' found or invalid JSON specified 2021-03-30T05:13:42.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1203: _objectstore_tool_nodown: return 1 2021-03-30T05:13:42.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1214: _objectstore_tool_nowait: return 1 2021-03-30T05:13:42.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1240: objectstore_tool: return 1 2021-03-30T05:13:42.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: test_objectstore_tool: teardown td/ceph-helpers 2021-03-30T05:13:42.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:13:42.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:13:42.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:13:42.680 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:42.680 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:42.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:42.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:42.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:42.784 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:42.784 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:13:42.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:13:42.785 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:13:42.786 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:13:42.787 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:13:42.787 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:13:42.788 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:42.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:13:42.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:13:42.789 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:42.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:13:42.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:13:42.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:13:42.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:13:42.794 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:42.795 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:42.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:13:42.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:13:42.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:13:42.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:13:42.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_pg_scrub td/ceph-helpers 2021-03-30T05:13:42.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1801: test_pg_scrub: local dir=td/ceph-helpers 2021-03-30T05:13:42.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1803: test_pg_scrub: setup td/ceph-helpers 2021-03-30T05:13:42.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:13:42.799 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:13:42.799 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:13:42.799 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:13:42.799 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:13:42.800 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:13:42.800 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:13:42.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:13:42.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:13:42.800 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:13:42.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:13:42.802 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:13:42.802 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:13:42.803 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:13:42.803 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:13:42.803 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:13:42.803 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:13:42.804 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:42.804 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:13:42.804 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:13:42.804 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:13:42.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:13:42.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:13:42.806 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:13:42.806 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:13:42.806 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:42.807 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:42.807 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:13:42.807 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:13:42.807 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:13:42.807 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:13:42.809 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:13:42.809 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:42.810 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:42.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:13:42.810 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:13:42.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:13:42.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:13:42.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:13:42.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1804: test_pg_scrub: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:13:42.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:13:42.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:13:42.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:13:42.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:13:42.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:13:42.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:13:43.146 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:13:43.146 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:43.146 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:43.146 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:43.147 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:43.147 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:43.147 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:43.147 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:13:43.346 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:13:43.348 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:13:43.348 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:13:43.348 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:13:43.348 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:13:43.349 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:13:43.349 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:13:43.349 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:13:43.349 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:13:43.349 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:13:43.350 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:43.350 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:43.350 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:13:43.350 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:13:43.351 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:13:43.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:13:43.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:13:43.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:13:43.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:13:43.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:13:43.437 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:13:43.437 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:13:43.437 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:13:43.437 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:13:43.438 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:43.438 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:43.438 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:13:43.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:13:43.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:13:43.522 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1805: test_pg_scrub: run_mgr td/ceph-helpers x 2021-03-30T05:13:43.522 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:13:43.523 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:13:43.523 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:13:43.523 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:13:43.523 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:13:43.524 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:13:44.401 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:13:44.401 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:44.401 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:44.402 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:44.402 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:44.402 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:44.402 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:44.402 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:13:44.403 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:13:44.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1806: test_pg_scrub: run_osd td/ceph-helpers 0 2021-03-30T05:13:44.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:13:44.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:13:44.426 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:13:44.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:13:44.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:13:44.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:13:44.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:13:44.427 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:13:44.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:13:44.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:13:44.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:13:44.428 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:13:44.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:13:44.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:13:44.429 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:13:44.429 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:13:44.429 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:13:44.430 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:13:44.430 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:13:44.430 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:13:44.430 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:44.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:13:44.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:13:44.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:13:44.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:13:44.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:13:44.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:13:44.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:13:44.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:13:44.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:44.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:13:44.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:13:44.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:13:44.433 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:13:44.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=076fb001-cdc2-431d-a172-5f656e0e5274 2021-03-30T05:13:44.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 076fb001-cdc2-431d-a172-5f656e0e5274' 2021-03-30T05:13:44.434 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 076fb001-cdc2-431d-a172-5f656e0e5274 2021-03-30T05:13:44.434 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:13:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCIs2Jg/484GhAAUBK1/x6a9mymAOvVYNOAGg== 2021-03-30T05:13:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCIs2Jg/484GhAAUBK1/x6a9mymAOvVYNOAGg=="}' 2021-03-30T05:13:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 076fb001-cdc2-431d-a172-5f656e0e5274 -i td/ceph-helpers/0/new.json 2021-03-30T05:13:44.749 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:13:44.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:13:44.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCIs2Jg/484GhAAUBK1/x6a9mymAOvVYNOAGg== --osd-uuid 076fb001-cdc2-431d-a172-5f656e0e5274 2021-03-30T05:13:44.783 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:44.783+0000 7f7349c54f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:44.785 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:44.785+0000 7f7349c54f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:44.787 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:44.786+0000 7f7349c54f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:44.787 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:44.787+0000 7f7349c54f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:44.788 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:44.787+0000 7f7349c54f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:44.788 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:44.787+0000 7f7349c54f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:13:44.828 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:44.828+0000 7f7349c54f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:13:45.272 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:45.272+0000 7f7349c54f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:13:47.881 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:13:47.881 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:13:47.882 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:13:47.882 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:13:47.883 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:13:48.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:13:48.163 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:13:48.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:13:48.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:13:48.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:13:48.164 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:13:48.183 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:48.183+0000 7f5160871f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:48.185 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:48.185+0000 7f5160871f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:48.187 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:48.187+0000 7f5160871f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:13:48.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:13:48.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:13:48.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:13:48.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:13:48.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:13:48.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:13:48.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:13:48.527 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:13:48.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:13:48.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:13:48.707 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:48.707+0000 7f5160871f40 -1 Falling back to public interface 2021-03-30T05:13:48.876 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:13:49.446 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:13:49.446+0000 7f5160871f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:13:49.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:13:49.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:13:49.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:13:49.878 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:13:49.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:13:49.879 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:13:50.287 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/62995,v1:127.0.0.1:6803/62995] [v2:127.0.0.1:6804/62995,v1:127.0.0.1:6805/62995] exists,up 076fb001-cdc2-431d-a172-5f656e0e5274 2021-03-30T05:13:50.287 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:13:50.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:13:50.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:13:50.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1807: test_pg_scrub: create_rbd_pool 2021-03-30T05:13:50.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:13:50.673 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:13:50.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:13:50.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:13:51.181 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:13:51.189 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:13:52.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:13:53.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1808: test_pg_scrub: wait_for_clean 2021-03-30T05:13:53.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:13:53.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:13:53.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:13:53.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:13:53.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:13:53.106 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:13:53.106 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:13:53.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:13:53.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:13:53.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:13:53.203 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:13:53.203 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:13:53.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:13:53.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:13:53.204 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:13:53.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:13:53.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:13:53.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:13:53.558 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:13:53.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:13:53.685 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:13:53.686 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:13:53.686 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:13:53.686 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:13:53.687 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:13:53.688 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:13:53.688 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:13:53.688 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:13:53.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:13:53.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:13:53.689 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:13:53.690 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:13:54.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:13:54.079 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:13:54.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:13:54.080 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:13:54.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:13:54.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:13:54.540 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:13:54.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:13:54.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:13:54.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:13:54.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:13:54.542 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:13:54.881 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:13:54.881 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:13:54.882 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:13:54.882 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:13:55.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:13:55.340 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:13:55.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:13:55.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1809: test_pg_scrub: pg_scrub 1.0 2021-03-30T05:13:55.341 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: local pgid=1.0 2021-03-30T05:13:55.341 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: get_last_scrub_stamp 1.0 2021-03-30T05:13:55.341 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:13:55.342 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:13:55.342 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:13:55.342 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:13:55.682 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: local last_scrub=2021-03-30T05:13:50.961120+0000 2021-03-30T05:13:55.683 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: pg_scrub: ceph pg scrub 1.0 2021-03-30T05:13:56.018 INFO:tasks.workunit.client.0.smithi197.stderr:instructing pg 1.0 on osd.0 to scrub 2021-03-30T05:13:56.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1790: pg_scrub: wait_for_scrub 1.0 2021-03-30T05:13:50.961120+0000 2021-03-30T05:13:56.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local pgid=1.0 2021-03-30T05:13:56.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1880: wait_for_scrub: local last_scrub=2021-03-30T05:13:50.961120+0000 2021-03-30T05:13:56.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: local sname=last_scrub_stamp 2021-03-30T05:13:56.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i=0 )) 2021-03-30T05:13:56.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:13:56.029 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:13:56.029 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:13:56.029 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:13:56.030 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:13:56.030 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:13:56.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:13:50.961120+0000 '>' 2021-03-30T05:13:50.961120+0000 2021-03-30T05:13:56.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:13:57.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:13:57.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:13:57.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:13:57.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:13:57.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:13:57.367 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:13:57.368 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:13:57.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:13:50.961120+0000 '>' 2021-03-30T05:13:50.961120+0000 2021-03-30T05:13:57.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:13:58.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:13:58.721 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:13:58.722 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:13:58.722 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:13:58.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:13:58.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:13:58.723 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:13:59.115 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:13:50.961120+0000 '>' 2021-03-30T05:13:50.961120+0000 2021-03-30T05:13:59.115 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:00.117 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:00.117 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:14:00.117 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:00.118 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:00.118 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:00.118 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:00.118 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:00.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:13:50.961120+0000 '>' 2021-03-30T05:13:50.961120+0000 2021-03-30T05:14:00.469 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:01.471 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:01.471 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:14:01.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:01.472 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:01.472 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:01.472 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:01.472 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:01.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:13:50.961120+0000 '>' 2021-03-30T05:13:50.961120+0000 2021-03-30T05:14:01.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:02.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:02.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:14:02.824 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:02.824 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:02.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:02.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:02.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:03.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:13:56.514467+0000 '>' 2021-03-30T05:13:50.961120+0000 2021-03-30T05:14:03.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: return 0 2021-03-30T05:14:03.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1810: test_pg_scrub: kill_daemons td/ceph-helpers KILL osd 2021-03-30T05:14:03.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:03.177 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:03.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:03.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:03.177 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:03.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:03.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1811: test_pg_scrub: TIMEOUT=1 2021-03-30T05:14:03.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1811: test_pg_scrub: pg_scrub 1.0 2021-03-30T05:14:03.281 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1787: pg_scrub: local pgid=1.0 2021-03-30T05:14:03.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: get_last_scrub_stamp 1.0 2021-03-30T05:14:03.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:03.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:03.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:03.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:03.625 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1788: pg_scrub: local last_scrub=2021-03-30T05:13:56.514467+0000 2021-03-30T05:14:03.626 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1789: pg_scrub: ceph pg scrub 1.0 2021-03-30T05:14:03.960 INFO:tasks.workunit.client.0.smithi197.stderr:instructing pg 1.0 on osd.0 to scrub 2021-03-30T05:14:03.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1790: pg_scrub: wait_for_scrub 1.0 2021-03-30T05:13:56.514467+0000 2021-03-30T05:14:03.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local pgid=1.0 2021-03-30T05:14:03.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1880: wait_for_scrub: local last_scrub=2021-03-30T05:13:56.514467+0000 2021-03-30T05:14:03.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: local sname=last_scrub_stamp 2021-03-30T05:14:03.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i=0 )) 2021-03-30T05:14:03.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 1 )) 2021-03-30T05:14:03.970 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:03.970 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:03.971 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:03.971 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:03.971 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:04.309 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:13:56.514467+0000 '>' 2021-03-30T05:13:56.514467+0000 2021-03-30T05:14:04.309 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:05.311 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:05.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 1 )) 2021-03-30T05:14:05.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: wait_for_scrub: return 1 2021-03-30T05:14:05.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1812: test_pg_scrub: teardown td/ceph-helpers 2021-03-30T05:14:05.312 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:14:05.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:14:05.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:14:05.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:05.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:05.313 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:05.314 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:05.314 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:05.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:05.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:14:05.419 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:14:05.420 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:14:05.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:14:05.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:14:05.421 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:14:05.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:05.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:14:05.424 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:14:05.424 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:05.424 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:14:05.425 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:14:05.425 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:14:05.429 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:14:05.429 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:05.430 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:05.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:14:05.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:14:05.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:14:05.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:14:05.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_repair td/ceph-helpers 2021-03-30T05:14:05.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1761: test_repair: local dir=td/ceph-helpers 2021-03-30T05:14:05.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1763: test_repair: setup td/ceph-helpers 2021-03-30T05:14:05.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:14:05.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:14:05.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:14:05.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:14:05.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:14:05.434 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:05.434 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:05.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:05.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:05.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:05.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:05.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:14:05.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:14:05.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:14:05.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:14:05.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:14:05.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:14:05.438 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:05.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:14:05.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:14:05.439 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:05.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:14:05.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:14:05.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:14:05.441 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:14:05.441 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:05.441 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:05.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:14:05.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:14:05.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:14:05.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:14:05.444 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:14:05.444 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:05.444 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:05.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:14:05.446 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:14:05.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:14:05.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:14:05.446 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:14:05.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1764: test_repair: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:14:05.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:14:05.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:14:05.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:14:05.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:14:05.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:14:05.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:14:05.746 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:14:05.747 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:05.747 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:05.747 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:05.747 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:05.748 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:05.748 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:05.748 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:14:05.914 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:14:05.915 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:14:05.916 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:05.916 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:05.916 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:14:05.916 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:14:05.917 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:05.917 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:05.917 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:05.918 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:05.918 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:05.918 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:05.919 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:05.919 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:05.919 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:14:06.011 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:14:06.012 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:06.012 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:06.012 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:14:06.012 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:14:06.012 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:06.013 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:06.013 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:06.013 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:06.013 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:06.013 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:06.014 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:06.014 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:06.014 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:14:06.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1765: test_repair: run_mgr td/ceph-helpers x 2021-03-30T05:14:06.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:14:06.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:14:06.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:14:06.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:14:06.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:14:06.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:14:06.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:14:06.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:06.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:06.995 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:06.995 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:06.995 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:06.995 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:06.996 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:14:06.996 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:14:07.019 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1766: test_repair: run_osd td/ceph-helpers 0 2021-03-30T05:14:07.019 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:14:07.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:14:07.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:14:07.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:14:07.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:14:07.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:14:07.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:14:07.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:14:07.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:14:07.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:14:07.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:14:07.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:14:07.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:14:07.022 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:14:07.022 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:14:07.023 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:07.023 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:07.023 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:07.023 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:07.024 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:07.024 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:07.024 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:07.024 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:14:07.024 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:14:07.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:14:07.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:14:07.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:14:07.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:14:07.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:14:07.026 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:07.026 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:14:07.026 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:14:07.026 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:14:07.026 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:14:07.027 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=44fd6c2d-63ee-4ad3-a4e9-553516b0f18b 2021-03-30T05:14:07.027 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 44fd6c2d-63ee-4ad3-a4e9-553516b0f18b' 2021-03-30T05:14:07.027 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 44fd6c2d-63ee-4ad3-a4e9-553516b0f18b 2021-03-30T05:14:07.028 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:14:07.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQCfs2JgJLD+ARAALOZDf5CYcYssmI5VNeOlog== 2021-03-30T05:14:07.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQCfs2JgJLD+ARAALOZDf5CYcYssmI5VNeOlog=="}' 2021-03-30T05:14:07.034 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 44fd6c2d-63ee-4ad3-a4e9-553516b0f18b -i td/ceph-helpers/0/new.json 2021-03-30T05:14:07.360 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:14:07.369 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:14:07.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCfs2JgJLD+ARAALOZDf5CYcYssmI5VNeOlog== --osd-uuid 44fd6c2d-63ee-4ad3-a4e9-553516b0f18b 2021-03-30T05:14:07.392 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.392+0000 7f3d0512cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:07.394 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.394+0000 7f3d0512cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:07.396 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.395+0000 7f3d0512cf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:07.397 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.396+0000 7f3d0512cf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:07.397 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.396+0000 7f3d0512cf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:07.397 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.396+0000 7f3d0512cf40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:07.438 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.438+0000 7f3d0512cf40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:14:07.906 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:07.906+0000 7f3d0512cf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:14:10.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:14:10.526 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:14:10.527 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:14:10.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:14:10.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:14:11.020 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:14:11.020 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:14:11.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:11.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:14:11.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:14:11.021 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:14:11.039 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:11.038+0000 7fc1eba93f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:11.041 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:11.040+0000 7fc1eba93f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:11.043 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:11.042+0000 7fc1eba93f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:11.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:14:11.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:14:11.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:14:11.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:14:11.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:14:11.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:11.412 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:14:11.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:14:11.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:11.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:14:11.558 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:11.556+0000 7fc1eba93f40 -1 Falling back to public interface 2021-03-30T05:14:11.765 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:14:12.338 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:12.336+0000 7fc1eba93f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:14:12.766 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:14:12.766 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:12.767 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:14:12.767 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:14:12.768 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:12.768 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:14:13.180 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/64282,v1:127.0.0.1:6803/64282] [v2:127.0.0.1:6804/64282,v1:127.0.0.1:6805/64282] exists,up 44fd6c2d-63ee-4ad3-a4e9-553516b0f18b 2021-03-30T05:14:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:14:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:14:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:14:13.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1767: test_repair: create_rbd_pool 2021-03-30T05:14:13.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:14:13.564 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:14:13.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:14:13.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:14:14.233 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:14:14.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:14:15.243 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:14:16.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1768: test_repair: wait_for_clean 2021-03-30T05:14:16.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:14:16.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:14:16.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:14:16.274 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:14:16.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:14:16.275 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:14:16.275 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:14:16.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:14:16.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:14:16.276 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:14:16.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:14:16.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:14:16.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:14:16.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:14:16.374 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:14:16.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:14:16.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:14:16.739 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:14:16.740 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:14:16.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836483 2021-03-30T05:14:16.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836483 2021-03-30T05:14:16.864 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836483' 2021-03-30T05:14:16.865 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:14:16.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836483 2021-03-30T05:14:16.865 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:14:16.866 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:14:16.866 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836483 2021-03-30T05:14:16.866 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:14:16.867 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836483 2021-03-30T05:14:16.867 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2021-03-30T05:14:16.867 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836483 2021-03-30T05:14:16.868 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:14:17.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836481 -lt 21474836483 2021-03-30T05:14:17.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:14:18.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:14:18.222 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:14:18.607 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836483 -lt 21474836483 2021-03-30T05:14:18.607 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:14:18.607 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:14:18.608 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:14:19.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:14:19.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:14:19.070 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:14:19.070 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:14:19.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:14:19.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:14:19.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:14:19.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:14:19.415 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:14:19.415 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:14:19.415 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:14:19.416 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:14:19.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:14:19.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:14:19.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:14:19.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1769: test_repair: repair 1.0 2021-03-30T05:14:19.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1754: repair: local pgid=1.0 2021-03-30T05:14:19.878 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: repair: get_last_scrub_stamp 1.0 2021-03-30T05:14:19.878 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:19.878 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:19.879 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:19.879 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:20.222 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: repair: local last_scrub=2021-03-30T05:14:13.913559+0000 2021-03-30T05:14:20.223 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: repair: ceph pg repair 1.0 2021-03-30T05:14:20.557 INFO:tasks.workunit.client.0.smithi197.stderr:instructing pg 1.0 on osd.0 to repair 2021-03-30T05:14:20.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1757: repair: wait_for_scrub 1.0 2021-03-30T05:14:13.913559+0000 2021-03-30T05:14:20.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local pgid=1.0 2021-03-30T05:14:20.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1880: wait_for_scrub: local last_scrub=2021-03-30T05:14:13.913559+0000 2021-03-30T05:14:20.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: local sname=last_scrub_stamp 2021-03-30T05:14:20.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i=0 )) 2021-03-30T05:14:20.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:14:20.568 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:20.568 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:20.568 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:20.568 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:20.569 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:20.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:14:13.913559+0000 '>' 2021-03-30T05:14:13.913559+0000 2021-03-30T05:14:20.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:21.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:21.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:14:21.906 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:21.906 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:21.906 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:21.906 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:21.907 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:22.254 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:14:13.913559+0000 '>' 2021-03-30T05:14:13.913559+0000 2021-03-30T05:14:22.254 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:23.256 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:23.256 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:14:23.256 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:23.257 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:23.257 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:23.257 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:23.257 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:23.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:14:13.913559+0000 '>' 2021-03-30T05:14:13.913559+0000 2021-03-30T05:14:23.603 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:24.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:24.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 300 )) 2021-03-30T05:14:24.606 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:24.606 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:24.606 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:24.606 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:24.606 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:24.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:14:21.396720+0000 '>' 2021-03-30T05:14:13.913559+0000 2021-03-30T05:14:24.955 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1885: wait_for_scrub: return 0 2021-03-30T05:14:24.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1770: test_repair: kill_daemons td/ceph-helpers KILL osd 2021-03-30T05:14:24.956 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:24.956 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:24.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:24.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:24.956 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:25.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:25.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1771: test_repair: TIMEOUT=1 2021-03-30T05:14:25.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1771: test_repair: repair 1.0 2021-03-30T05:14:25.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1754: repair: local pgid=1.0 2021-03-30T05:14:25.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: repair: get_last_scrub_stamp 1.0 2021-03-30T05:14:25.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:25.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:25.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:25.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:25.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1755: repair: local last_scrub=2021-03-30T05:14:21.396720+0000 2021-03-30T05:14:25.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1756: repair: ceph pg repair 1.0 2021-03-30T05:14:25.731 INFO:tasks.workunit.client.0.smithi197.stderr:instructing pg 1.0 on osd.0 to repair 2021-03-30T05:14:25.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1757: repair: wait_for_scrub 1.0 2021-03-30T05:14:21.396720+0000 2021-03-30T05:14:25.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1879: wait_for_scrub: local pgid=1.0 2021-03-30T05:14:25.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1880: wait_for_scrub: local last_scrub=2021-03-30T05:14:21.396720+0000 2021-03-30T05:14:25.741 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1881: wait_for_scrub: local sname=last_scrub_stamp 2021-03-30T05:14:25.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i=0 )) 2021-03-30T05:14:25.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 1 )) 2021-03-30T05:14:25.742 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2021-03-30T05:14:25.742 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1464: get_last_scrub_stamp: local pgid=1.0 2021-03-30T05:14:25.742 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1465: get_last_scrub_stamp: local sname=last_scrub_stamp 2021-03-30T05:14:25.742 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1466: get_last_scrub_stamp: ceph --format json pg dump pgs 2021-03-30T05:14:25.743 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1467: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2021-03-30T05:14:26.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1884: wait_for_scrub: test 2021-03-30T05:14:21.396720+0000 '>' 2021-03-30T05:14:21.396720+0000 2021-03-30T05:14:26.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: wait_for_scrub: sleep 1 2021-03-30T05:14:27.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i++ )) 2021-03-30T05:14:27.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1883: wait_for_scrub: (( i < 1 )) 2021-03-30T05:14:27.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: wait_for_scrub: return 1 2021-03-30T05:14:27.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1772: test_repair: teardown td/ceph-helpers 2021-03-30T05:14:27.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:14:27.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:14:27.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:14:27.086 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:27.086 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:27.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:27.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:27.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:27.190 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:27.191 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:14:27.191 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:14:27.192 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:14:27.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:14:27.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:14:27.193 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:14:27.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:27.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:14:27.195 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:14:27.196 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:27.196 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:14:27.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:14:27.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:14:27.200 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:14:27.201 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:27.201 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:27.201 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:14:27.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:14:27.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:14:27.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:14:27.204 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_run_in_background td/ceph-helpers 2021-03-30T05:14:27.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2012: test_run_in_background: local pids 2021-03-30T05:14:27.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2013: test_run_in_background: run_in_background pids sleep 1 2021-03-30T05:14:27.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1997: run_in_background: local pid_variable=pids 2021-03-30T05:14:27.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1998: run_in_background: shift 2021-03-30T05:14:27.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: eval 'pids+=" 65129"' 2021-03-30T05:14:27.205 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: pids+=' 65129' 2021-03-30T05:14:27.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2014: test_run_in_background: run_in_background pids sleep 1 2021-03-30T05:14:27.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1997: run_in_background: local pid_variable=pids 2021-03-30T05:14:27.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1998: run_in_background: shift 2021-03-30T05:14:27.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sleep 1 2021-03-30T05:14:27.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: eval 'pids+=" 65131"' 2021-03-30T05:14:27.207 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: pids+=' 65131' 2021-03-30T05:14:27.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sed 's/^/43807: /' 2021-03-30T05:14:27.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sleep 1 2021-03-30T05:14:27.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sed 's/^/43807: /' 2021-03-30T05:14:27.207 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2015: test_run_in_background: echo 65129 65131 2021-03-30T05:14:27.208 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2015: test_run_in_background: wc -w 2021-03-30T05:14:27.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2015: test_run_in_background: test 2 = 2 2021-03-30T05:14:27.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: test_run_in_background: wait 65129 65131 2021-03-30T05:14:28.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: return 0 2021-03-30T05:14:28.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: return 0 2021-03-30T05:14:28.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:14:28.205 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_run_mon td/ceph-helpers 2021-03-30T05:14:28.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:494: test_run_mon: local dir=td/ceph-helpers 2021-03-30T05:14:28.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:496: test_run_mon: setup td/ceph-helpers 2021-03-30T05:14:28.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:14:28.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:14:28.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:14:28.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:14:28.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:14:28.207 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:28.207 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:28.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:28.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:28.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:28.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:28.209 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:14:28.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:14:28.210 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:14:28.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:14:28.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:14:28.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:14:28.211 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:28.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:14:28.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:14:28.212 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:28.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:14:28.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:14:28.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:14:28.214 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:14:28.215 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:28.215 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:28.215 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:14:28.216 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:14:28.216 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:14:28.216 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:14:28.217 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:14:28.217 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:28.218 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:28.218 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:14:28.219 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:14:28.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:14:28.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:14:28.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:14:28.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:498: test_run_mon: run_mon td/ceph-helpers a --mon-initial-members=a 2021-03-30T05:14:28.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:14:28.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:14:28.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:14:28.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:14:28.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:14:28.221 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --mon-initial-members=a 2021-03-30T05:14:28.515 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:14:28.515 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:28.515 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:28.516 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:28.516 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:28.516 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:28.516 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:28.517 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --mon-initial-members=a 2021-03-30T05:14:28.691 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:14:28.693 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:14:28.693 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:28.693 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:28.693 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:14:28.694 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:14:28.694 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:28.694 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:28.694 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:28.695 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:28.696 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:28.696 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:28.696 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:28.696 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:28.696 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:14:28.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:14:28.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:28.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:28.790 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:14:28.791 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:14:28.791 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:28.791 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:28.791 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:28.791 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:28.792 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:28.792 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:28.792 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:28.792 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:28.793 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:14:28.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:499: test_run_mon: ceph mon dump 2021-03-30T05:14:28.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:499: test_run_mon: grep mon.a 2021-03-30T05:14:29.739 INFO:tasks.workunit.client.0.smithi197.stderr:dumped monmap epoch 1 2021-03-30T05:14:29.748 INFO:tasks.workunit.client.0.smithi197.stdout:0: v2:127.0.0.1:7109/0 mon.a 2021-03-30T05:14:29.748 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:500: test_run_mon: kill_daemons td/ceph-helpers 2021-03-30T05:14:29.749 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:29.749 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:29.749 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:29.749 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:29.750 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:29.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:29.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:502: test_run_mon: run_mon td/ceph-helpers a --osd_pool_default_size=3 2021-03-30T05:14:29.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:14:29.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:14:29.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:14:29.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:14:29.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:14:29.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=3 2021-03-30T05:14:29.870 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:29.870+0000 7fb92cb8d700 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2021-03-30T05:14:29.872 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:14:29.872 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:29.872 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:29.873 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:29.873 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:29.873 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:29.873 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:29.873 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2021-03-30T05:14:30.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:14:30.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:14:30.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:30.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:30.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:14:30.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:14:30.063 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:30.063 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:30.063 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:30.063 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:30.063 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:30.064 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:30.064 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:30.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:30.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:14:30.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:14:30.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:30.149 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:30.150 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:14:30.150 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:14:30.150 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:30.150 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:30.150 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:30.150 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:30.151 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:30.151 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:30.151 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:30.151 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:30.152 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:14:30.238 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:503: test_run_mon: run_osd td/ceph-helpers 0 2021-03-30T05:14:30.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:14:30.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:14:30.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:14:30.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:14:30.239 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:14:30.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:14:30.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:14:30.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:14:30.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:14:30.240 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:14:30.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:14:30.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:14:30.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:14:30.241 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:14:30.241 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:14:30.242 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:30.242 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:30.242 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:30.242 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:30.242 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:30.243 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:30.243 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:30.243 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:14:30.243 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:14:30.243 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:14:30.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:14:30.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:14:30.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:14:30.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:14:30.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:30.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:14:30.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:14:30.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:14:30.245 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:14:30.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=7e3ffcac-7273-410c-b283-6f7ef399a379 2021-03-30T05:14:30.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 7e3ffcac-7273-410c-b283-6f7ef399a379' 2021-03-30T05:14:30.246 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 7e3ffcac-7273-410c-b283-6f7ef399a379 2021-03-30T05:14:30.246 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:14:30.252 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC2s2JguGUHDxAA+o8GgAClNzadBMW5PfPaOw== 2021-03-30T05:14:30.252 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC2s2JguGUHDxAA+o8GgAClNzadBMW5PfPaOw=="}' 2021-03-30T05:14:30.252 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 7e3ffcac-7273-410c-b283-6f7ef399a379 -i td/ceph-helpers/0/new.json 2021-03-30T05:14:30.569 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:14:30.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:14:30.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC2s2JguGUHDxAA+o8GgAClNzadBMW5PfPaOw== --osd-uuid 7e3ffcac-7273-410c-b283-6f7ef399a379 2021-03-30T05:14:30.601 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:30.600+0000 7fa305066f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:30.602 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:30.602+0000 7fa305066f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:30.604 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:30.604+0000 7fa305066f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:30.605 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:30.605+0000 7fa305066f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:30.605 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:30.605+0000 7fa305066f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:30.605 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:30.605+0000 7fa305066f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:30.682 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:30.682+0000 7fa305066f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:14:31.076 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:31.076+0000 7fa305066f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:14:33.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:14:33.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:14:33.759 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:14:33.759 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:14:33.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:14:33.988 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:14:33.988 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:14:33.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:33.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:14:33.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:14:33.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:14:34.008 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:34.008+0000 7f09cffa7f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:34.015 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:34.015+0000 7f09cffa7f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:34.016 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:34.016+0000 7f09cffa7f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:34.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:14:34.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:14:34.197 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:14:34.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:14:34.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:14:34.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:34.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:14:34.199 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:14:34.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:34.200 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:14:34.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:14:34.532 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:34.532+0000 7f09cffa7f40 -1 Falling back to public interface 2021-03-30T05:14:35.390 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:35.390+0000 7f09cffa7f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:14:35.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:14:35.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:35.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:14:35.410 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:14:35.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:35.412 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:14:35.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:14:36.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:14:36.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:36.679 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:14:36.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:14:36.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:36.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:14:36.897 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/65510,v1:127.0.0.1:6801/65510] [v2:127.0.0.1:6802/65510,v1:127.0.0.1:6803/65510] exists,up 7e3ffcac-7273-410c-b283-6f7ef399a379 2021-03-30T05:14:36.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:14:36.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:14:36.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:14:36.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:504: test_run_mon: run_osd td/ceph-helpers 1 2021-03-30T05:14:36.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:14:36.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:14:36.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:14:36.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:14:36.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:14:36.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:14:36.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:14:36.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:14:36.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:14:36.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:14:36.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:14:36.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:14:36.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:14:36.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:14:36.905 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:14:36.906 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:36.906 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:36.906 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:36.906 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:36.906 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:36.907 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:36.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:36.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:14:36.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:14:36.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:14:36.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:14:36.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:14:36.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:14:36.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:14:36.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:36.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:14:36.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:14:36.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:14:36.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:14:36.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e86361a9-6024-4fcc-ac2c-485d26116677 2021-03-30T05:14:36.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 e86361a9-6024-4fcc-ac2c-485d26116677' 2021-03-30T05:14:36.910 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 e86361a9-6024-4fcc-ac2c-485d26116677 2021-03-30T05:14:36.910 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:14:36.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQC8s2JgDSuHNhAA1pP4lc3/GQK6tLH/2Ccrfw== 2021-03-30T05:14:36.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQC8s2JgDSuHNhAA1pP4lc3/GQK6tLH/2Ccrfw=="}' 2021-03-30T05:14:36.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e86361a9-6024-4fcc-ac2c-485d26116677 -i td/ceph-helpers/1/new.json 2021-03-30T05:14:37.199 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:14:37.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/1/new.json 2021-03-30T05:14:37.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQC8s2JgDSuHNhAA1pP4lc3/GQK6tLH/2Ccrfw== --osd-uuid e86361a9-6024-4fcc-ac2c-485d26116677 2021-03-30T05:14:37.230 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.230+0000 7f55d6856f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:37.231 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.231+0000 7f55d6856f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:37.233 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.233+0000 7f55d6856f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:37.234 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.234+0000 7f55d6856f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:14:37.234 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.234+0000 7f55d6856f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:14:37.235 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.234+0000 7f55d6856f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:14:37.305 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.305+0000 7f55d6856f40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2021-03-30T05:14:37.765 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:37.765+0000 7f55d6856f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:14:40.348 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/1/keyring 2021-03-30T05:14:40.349 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:14:40.350 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:14:40.350 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:14:40.350 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:14:40.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:14:40.579 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:14:40.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:40.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:14:40.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:14:40.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:14:40.599 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:40.599+0000 7f15e8e66f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:40.601 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:40.601+0000 7f15e8e66f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:40.603 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:40.602+0000 7f15e8e66f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:40.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:14:40.789 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:14:40.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:14:40.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:14:40.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:14:40.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:40.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:14:40.791 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:14:40.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:40.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:14:41.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:14:41.119 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:41.119+0000 7f15e8e66f40 -1 Falling back to public interface 2021-03-30T05:14:41.896 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:41.895+0000 7f15e8e66f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:14:42.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:14:42.017 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:42.017 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:14:42.017 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:14:42.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:42.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:14:42.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:14:43.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:14:43.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:43.271 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:14:43.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:14:43.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:43.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:14:43.486 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/65893,v1:127.0.0.1:6809/65893] [v2:127.0.0.1:6810/65893,v1:127.0.0.1:6811/65893] exists,up e86361a9-6024-4fcc-ac2c-485d26116677 2021-03-30T05:14:43.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:14:43.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:14:43.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:14:43.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:505: test_run_mon: run_osd td/ceph-helpers 2 2021-03-30T05:14:43.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:14:43.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:14:43.496 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2021-03-30T05:14:43.497 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:14:43.497 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/2 2021-03-30T05:14:43.497 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:14:43.498 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:14:43.498 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:14:43.498 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:14:43.499 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2021-03-30T05:14:43.499 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2021-03-30T05:14:43.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:14:43.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:14:43.500 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:14:43.501 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:14:43.501 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:43.501 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:43.502 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:43.502 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:43.502 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:43.503 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:43.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:43.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:14:43.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:14:43.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:14:43.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:14:43.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:14:43.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:14:43.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:14:43.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:43.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:14:43.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:14:43.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/2 2021-03-30T05:14:43.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:14:43.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=114be9d2-d501-464a-bd8a-299cd6136cb7 2021-03-30T05:14:43.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 114be9d2-d501-464a-bd8a-299cd6136cb7' 2021-03-30T05:14:43.509 INFO:tasks.workunit.client.0.smithi197.stdout:add osd2 114be9d2-d501-464a-bd8a-299cd6136cb7 2021-03-30T05:14:43.510 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:14:43.510 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDDs2Jg3rENHhAAAcQiDg0TVFy83Rc0lrveLQ== 2021-03-30T05:14:43.511 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDDs2Jg3rENHhAAAcQiDg0TVFy83Rc0lrveLQ=="}' 2021-03-30T05:14:43.511 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 114be9d2-d501-464a-bd8a-299cd6136cb7 -i td/ceph-helpers/2/new.json 2021-03-30T05:14:43.807 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:14:43.817 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/2/new.json 2021-03-30T05:14:43.818 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDDs2Jg3rENHhAAAcQiDg0TVFy83Rc0lrveLQ== --osd-uuid 114be9d2-d501-464a-bd8a-299cd6136cb7 2021-03-30T05:14:43.840 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:43.840+0000 7f28a3c7ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:43.842 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:43.842+0000 7f28a3c7ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:43.843 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:43.843+0000 7f28a3c7ef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:43.844 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:43.843+0000 7f28a3c7ef40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:14:43.844 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:43.843+0000 7f28a3c7ef40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:14:43.844 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:43.843+0000 7f28a3c7ef40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:14:43.921 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:43.921+0000 7f28a3c7ef40 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2021-03-30T05:14:44.314 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:44.314+0000 7f28a3c7ef40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:14:46.988 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/2/keyring 2021-03-30T05:14:46.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:14:46.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2021-03-30T05:14:46.990 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd2 key to auth repository 2021-03-30T05:14:46.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:14:47.218 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2021-03-30T05:14:47.219 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:14:47.219 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:47.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:14:47.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:14:47.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:14:47.239 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:47.238+0000 7f558f8ecf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:47.254 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:47.254+0000 7f558f8ecf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:47.256 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:47.256+0000 7f558f8ecf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:47.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2021-03-30T05:14:47.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:14:47.429 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:14:47.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:14:47.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:14:47.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:47.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:14:47.431 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:14:47.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:47.431 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:14:47.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:14:47.774 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:47.773+0000 7f558f8ecf40 -1 Falling back to public interface 2021-03-30T05:14:48.563 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:48.562+0000 7f558f8ecf40 -1 osd.2 0 log_to_monitors {default=true} 2021-03-30T05:14:48.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:14:48.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:48.641 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:14:48.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:14:48.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:48.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:14:48.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:14:49.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:14:49.905 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:14:49.905 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:14:49.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:14:49.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:14:49.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:14:50.123 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/66276,v1:127.0.0.1:6817/66276] [v2:127.0.0.1:6818/66276,v1:127.0.0.1:6819/66276] exists,up 114be9d2-d501-464a-bd8a-299cd6136cb7 2021-03-30T05:14:50.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:14:50.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:14:50.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:14:50.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:506: test_run_mon: create_rbd_pool 2021-03-30T05:14:50.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:14:50.368 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:14:50.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:14:50.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:14:50.733 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:14:50.742 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:14:51.743 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:14:53.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:507: test_run_mon: ceph osd dump 2021-03-30T05:14:53.495 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:507: test_run_mon: grep 'pool 1 '\''rbd'\''' 2021-03-30T05:14:53.709 INFO:tasks.workunit.client.0.smithi197.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 4 pgp_num 4 autoscale_mode off last_change 24 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd 2021-03-30T05:14:53.711 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:509: test_run_mon: get_asok_path mon.a 2021-03-30T05:14:53.711 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:53.711 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:53.711 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:53.712 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:53.712 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:53.712 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:53.712 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:509: test_run_mon: CEPH_ARGS= 2021-03-30T05:14:53.713 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:509: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get osd_pool_default_size 2021-03-30T05:14:53.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:509: test_run_mon: local 'size={"osd_pool_default_size":"3"}' 2021-03-30T05:14:53.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:510: test_run_mon: test '{"osd_pool_default_size":"3"}' = '{"osd_pool_default_size":"3"}' 2021-03-30T05:14:53.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:512: test_run_mon: CEPH_ARGS= 2021-03-30T05:14:53.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:512: test_run_mon: ceph status 2021-03-30T05:14:53.870 INFO:tasks.workunit.client.0.smithi197.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2021-03-30T05:14:53.871 INFO:tasks.workunit.client.0.smithi197.stderr:[errno 2] RADOS object not found (error connecting to the cluster) 2021-03-30T05:14:53.871 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:513: test_run_mon: CEPH_ARGS= 2021-03-30T05:14:53.872 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:513: test_run_mon: ceph --conf td/ceph-helpers/ceph.conf status 2021-03-30T05:14:53.949 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.946+0000 7f1bc9b20700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2021-03-30T05:14:53.949 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.946+0000 7f1bc9b20700 -1 AuthRegistry(0x7f1bc405e860) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx 2021-03-30T05:14:53.950 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.946+0000 7f1bc9b20700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2021-03-30T05:14:53.950 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.946+0000 7f1bc9b20700 -1 AuthRegistry(0x7f1bc9b1f050) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx 2021-03-30T05:14:53.950 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.948+0000 7f1bc9b20700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2021-03-30T05:14:53.950 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.948+0000 7f1bc9b20700 -1 AuthRegistry(0x7f1bc4059ef0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx 2021-03-30T05:14:53.950 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.948+0000 7f1bc9b20700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2021-03-30T05:14:53.951 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.948+0000 7f1bc9b20700 -1 AuthRegistry(0x7f1bc40690a0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx 2021-03-30T05:14:53.951 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.948+0000 7f1bc9b20700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2021-03-30T05:14:53.951 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:53.948+0000 7f1bc9b20700 -1 AuthRegistry(0x7f1bc4059ef0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,, disabling cephx 2021-03-30T05:14:54.072 INFO:tasks.workunit.client.0.smithi197.stdout: cluster: 2021-03-30T05:14:54.072 INFO:tasks.workunit.client.0.smithi197.stdout: id: 56d309ad-176e-4c93-a3be-41f06f3ac8af 2021-03-30T05:14:54.073 INFO:tasks.workunit.client.0.smithi197.stdout: health: HEALTH_OK 2021-03-30T05:14:54.073 INFO:tasks.workunit.client.0.smithi197.stdout: 2021-03-30T05:14:54.073 INFO:tasks.workunit.client.0.smithi197.stdout: services: 2021-03-30T05:14:54.073 INFO:tasks.workunit.client.0.smithi197.stdout: mon: 1 daemons, quorum a (age 23s) 2021-03-30T05:14:54.074 INFO:tasks.workunit.client.0.smithi197.stdout: mgr: no daemons active 2021-03-30T05:14:54.074 INFO:tasks.workunit.client.0.smithi197.stdout: osd: 3 osds: 3 up (since 4s), 3 in (since 4s) 2021-03-30T05:14:54.074 INFO:tasks.workunit.client.0.smithi197.stdout: 2021-03-30T05:14:54.074 INFO:tasks.workunit.client.0.smithi197.stdout: data: 2021-03-30T05:14:54.074 INFO:tasks.workunit.client.0.smithi197.stdout: pools: 0 pools, 0 pgs 2021-03-30T05:14:54.075 INFO:tasks.workunit.client.0.smithi197.stdout: objects: 0 objects, 0 B 2021-03-30T05:14:54.075 INFO:tasks.workunit.client.0.smithi197.stdout: usage: 0 B used, 0 B / 0 B avail 2021-03-30T05:14:54.075 INFO:tasks.workunit.client.0.smithi197.stdout: pgs: 2021-03-30T05:14:54.075 INFO:tasks.workunit.client.0.smithi197.stdout: 2021-03-30T05:14:54.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:515: test_run_mon: kill_daemons td/ceph-helpers 2021-03-30T05:14:54.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:54.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:54.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:54.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:54.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:54.389 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:54.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:517: test_run_mon: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:14:54.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:14:54.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:14:54.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:14:54.390 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:14:54.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:14:54.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:14:54.408 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:54.407+0000 7ffa8a32a700 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2021-03-30T05:14:54.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:14:54.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:54.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:54.410 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:54.411 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:54.411 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:54.411 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:54.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:14:54.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:14:54.574 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:14:54.575 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:54.575 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:54.575 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:14:54.575 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:14:54.576 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:54.576 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:54.576 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:54.576 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:54.576 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:54.577 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:54.577 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:54.577 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:54.578 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:14:54.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:14:54.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:54.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:54.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:14:54.664 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:14:54.664 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:54.664 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:54.664 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:54.664 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:54.665 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:54.665 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:54.665 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:54.665 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:54.665 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:14:54.750 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:519: test_run_mon: get_asok_path mon.a 2021-03-30T05:14:54.750 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:54.750 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:54.751 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:54.751 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:54.751 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:54.751 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:54.752 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:519: test_run_mon: CEPH_ARGS= 2021-03-30T05:14:54.752 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:519: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get osd_pool_default_size 2021-03-30T05:14:54.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:519: test_run_mon: local 'size={"osd_pool_default_size":"1"}' 2021-03-30T05:14:54.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:520: test_run_mon: test '{"osd_pool_default_size":"1"}' = '{"osd_pool_default_size":"1"}' 2021-03-30T05:14:54.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:521: test_run_mon: kill_daemons td/ceph-helpers 2021-03-30T05:14:54.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:54.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:54.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:54.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:54.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:54.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:54.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:523: test_run_mon: CEPH_ARGS='--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd_pool_default_size=2' 2021-03-30T05:14:54.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:523: test_run_mon: run_mon td/ceph-helpers a 2021-03-30T05:14:54.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:14:54.942 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:14:54.943 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:14:54.943 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:14:54.943 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:14:54.943 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2021-03-30T05:14:54.959 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:54.958+0000 7f77c9906700 -1 'td/ceph-helpers/a' already exists and is not empty: monitor may already exist 2021-03-30T05:14:54.961 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:14:54.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:54.962 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:54.962 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:54.962 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:54.962 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:54.963 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:54.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:14:55.192 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:14:55.193 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:14:55.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:55.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:55.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:14:55.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:14:55.195 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:55.195 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:55.195 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:55.195 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:55.195 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:55.196 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:55.196 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:55.196 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:55.197 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:14:55.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:14:55.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:55.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:55.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:14:55.282 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:14:55.282 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:55.282 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:55.283 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:55.283 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:55.283 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:55.283 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:55.283 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:55.284 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:55.284 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:14:55.368 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: test_run_mon: get_asok_path mon.a 2021-03-30T05:14:55.368 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:55.369 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:55.369 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:55.369 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:55.369 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:55.370 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:55.370 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: test_run_mon: CEPH_ARGS= 2021-03-30T05:14:55.370 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: test_run_mon: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get osd_pool_default_size 2021-03-30T05:14:55.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: test_run_mon: local 'size={"osd_pool_default_size":"2"}' 2021-03-30T05:14:55.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: test_run_mon: test '{"osd_pool_default_size":"2"}' = '{"osd_pool_default_size":"2"}' 2021-03-30T05:14:55.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: test_run_mon: kill_daemons td/ceph-helpers 2021-03-30T05:14:55.455 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:55.455 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:55.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:55.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:55.456 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:55.560 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:55.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:530: test_run_mon: teardown td/ceph-helpers 2021-03-30T05:14:55.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:14:55.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:14:55.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:14:55.561 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:55.562 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:55.562 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:55.562 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:55.562 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:55.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:55.564 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:14:55.565 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:14:55.565 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:14:55.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:14:55.566 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:14:55.567 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:14:55.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:55.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:14:55.568 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:14:55.569 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:55.569 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:14:55.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:14:55.570 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:14:55.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:14:55.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:55.574 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:55.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:14:55.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:14:55.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:14:55.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:14:55.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_run_osd td/ceph-helpers 2021-03-30T05:14:55.576 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:743: test_run_osd: local dir=td/ceph-helpers 2021-03-30T05:14:55.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:745: test_run_osd: setup td/ceph-helpers 2021-03-30T05:14:55.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:14:55.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:14:55.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:14:55.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:14:55.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:14:55.578 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:14:55.578 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:14:55.578 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:14:55.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:14:55.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:14:55.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:14:55.581 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:14:55.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:14:55.581 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:14:55.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:14:55.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:14:55.582 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:14:55.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:55.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:14:55.582 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:14:55.582 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:14:55.583 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:14:55.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:14:55.584 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:14:55.584 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:14:55.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:55.585 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:55.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:14:55.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:14:55.585 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:14:55.586 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:14:55.587 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:14:55.588 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:55.588 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:55.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:14:55.588 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:14:55.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:14:55.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:14:55.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:14:55.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:747: test_run_osd: run_mon td/ceph-helpers a 2021-03-30T05:14:55.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:14:55.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:14:55.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:14:55.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:14:55.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:14:55.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers 2021-03-30T05:14:55.887 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:14:55.887 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:55.887 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:55.888 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:55.888 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:55.888 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:55.888 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:55.888 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2021-03-30T05:14:56.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:14:56.072 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:14:56.072 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:56.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:56.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:14:56.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:14:56.073 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:56.073 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:56.074 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:56.074 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:56.074 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:56.074 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:56.074 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:56.075 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:56.075 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:14:56.159 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:14:56.159 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:14:56.159 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:14:56.159 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:14:56.160 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:14:56.160 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:14:56.160 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:14:56.160 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:14:56.160 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:14:56.161 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:56.161 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:56.161 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:14:56.161 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:14:56.161 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:14:56.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:748: test_run_osd: run_mgr td/ceph-helpers x 2021-03-30T05:14:56.245 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:14:56.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:14:56.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:14:56.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:14:56.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:14:56.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:14:57.126 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:14:57.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:57.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:57.127 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:57.127 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:57.128 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:57.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:57.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:14:57.129 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:14:57.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:750: test_run_osd: run_osd td/ceph-helpers 0 2021-03-30T05:14:57.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:14:57.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:14:57.153 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:14:57.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:14:57.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:14:57.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:14:57.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:14:57.154 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:14:57.155 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:14:57.155 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:14:57.155 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:14:57.155 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:14:57.155 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:14:57.156 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:14:57.156 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:14:57.156 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:14:57.156 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:14:57.156 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:14:57.157 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:14:57.157 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:14:57.157 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:57.157 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:14:57.157 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:14:57.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:14:57.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:14:57.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:14:57.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:14:57.158 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:14:57.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:14:57.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:14:57.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:14:57.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:14:57.159 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:14:57.160 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:14:57.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=540ca8b3-5f4e-433f-96ac-d44908891d18 2021-03-30T05:14:57.160 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 540ca8b3-5f4e-433f-96ac-d44908891d18' 2021-03-30T05:14:57.160 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 540ca8b3-5f4e-433f-96ac-d44908891d18 2021-03-30T05:14:57.161 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:14:57.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDRs2JgweT2CRAAs98UIARx4nSua9DX2mzk1A== 2021-03-30T05:14:57.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDRs2JgweT2CRAAs98UIARx4nSua9DX2mzk1A=="}' 2021-03-30T05:14:57.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 540ca8b3-5f4e-433f-96ac-d44908891d18 -i td/ceph-helpers/0/new.json 2021-03-30T05:14:57.492 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:14:57.502 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:14:57.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDRs2JgweT2CRAAs98UIARx4nSua9DX2mzk1A== --osd-uuid 540ca8b3-5f4e-433f-96ac-d44908891d18 2021-03-30T05:14:57.525 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:57.524+0000 7f66a433df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:57.527 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:57.526+0000 7f66a433df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:57.528 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:57.527+0000 7f66a433df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:14:57.529 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:57.528+0000 7f66a433df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:57.529 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:57.528+0000 7f66a433df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:57.529 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:57.528+0000 7f66a433df40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:14:57.635 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:57.633+0000 7f66a433df40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:14:58.013 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:14:58.012+0000 7f66a433df40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:15:00.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:15:00.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:15:00.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:15:00.691 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:15:00.691 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:15:01.163 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:15:01.164 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:15:01.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:01.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:15:01.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:15:01.165 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:15:01.183 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:01.182+0000 7fa8ffa5ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:01.185 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:01.184+0000 7fa8ffa5ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:01.186 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:01.185+0000 7fa8ffa5ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:01.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:15:01.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:15:01.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:15:01.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:15:01.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:15:01.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:01.542 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:15:01.543 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:15:01.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:01.543 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:15:01.702 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:01.701+0000 7fa8ffa5ff40 -1 Falling back to public interface 2021-03-30T05:15:01.895 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:15:02.486 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:02.485+0000 7fa8ffa5ff40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:15:02.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:15:02.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:02.897 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:15:02.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:15:02.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:02.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:15:03.270 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/67255,v1:127.0.0.1:6803/67255] [v2:127.0.0.1:6804/67255,v1:127.0.0.1:6805/67255] exists,up 540ca8b3-5f4e-433f-96ac-d44908891d18 2021-03-30T05:15:03.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:15:03.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:15:03.272 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:15:03.273 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:752: test_run_osd: get_asok_path osd.0 2021-03-30T05:15:03.273 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2021-03-30T05:15:03.273 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2021-03-30T05:15:03.273 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:03.273 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:03.274 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:03.274 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-osd.0.asok 2021-03-30T05:15:03.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:752: test_run_osd: CEPH_ARGS= 2021-03-30T05:15:03.274 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:752: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-osd.0.asok config get osd_max_backfills 2021-03-30T05:15:03.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:752: test_run_osd: local 'backfills={"osd_max_backfills":"1"}' 2021-03-30T05:15:03.365 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:753: test_run_osd: echo '{"osd_max_backfills":"1"}' 2021-03-30T05:15:03.366 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:753: test_run_osd: grep --quiet osd_max_backfills 2021-03-30T05:15:03.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:755: test_run_osd: run_osd td/ceph-helpers 1 --osd-max-backfills 20 2021-03-30T05:15:03.370 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:15:03.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:15:03.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:15:03.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:15:03.371 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:15:03.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:15:03.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:15:03.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:15:03.372 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:15:03.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:15:03.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:15:03.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:15:03.373 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:15:03.374 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:15:03.374 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:15:03.374 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:03.374 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:03.375 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:03.375 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:03.375 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:03.375 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:03.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:03.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:15:03.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:15:03.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:15:03.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:15:03.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:15:03.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:15:03.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:15:03.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:03.378 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:15:03.378 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+='--osd-max-backfills 20' 2021-03-30T05:15:03.378 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:15:03.378 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:15:03.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=e9d4aedf-a347-42ac-a899-30a6bdee2a1c 2021-03-30T05:15:03.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 e9d4aedf-a347-42ac-a899-30a6bdee2a1c' 2021-03-30T05:15:03.379 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 e9d4aedf-a347-42ac-a899-30a6bdee2a1c 2021-03-30T05:15:03.380 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:15:03.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDXs2JgEszXFhAAqOOmRv4HO4t+enlxmLiJIQ== 2021-03-30T05:15:03.384 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDXs2JgEszXFhAAqOOmRv4HO4t+enlxmLiJIQ=="}' 2021-03-30T05:15:03.384 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new e9d4aedf-a347-42ac-a899-30a6bdee2a1c -i td/ceph-helpers/1/new.json 2021-03-30T05:15:03.911 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:15:03.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/1/new.json 2021-03-30T05:15:03.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-max-backfills 20 --mkfs --key AQDXs2JgEszXFhAAqOOmRv4HO4t+enlxmLiJIQ== --osd-uuid e9d4aedf-a347-42ac-a899-30a6bdee2a1c 2021-03-30T05:15:03.945 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:03.944+0000 7f06310aaf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:03.946 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:03.946+0000 7f06310aaf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:03.947 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:03.947+0000 7f06310aaf40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:03.948 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:03.947+0000 7f06310aaf40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:15:03.948 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:03.947+0000 7f06310aaf40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:15:03.948 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:03.947+0000 7f06310aaf40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:15:04.011 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:04.011+0000 7f06310aaf40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2021-03-30T05:15:04.446 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:04.446+0000 7f06310aaf40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:15:07.437 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/1/keyring 2021-03-30T05:15:07.438 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:15:07.438 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:15:07.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:15:07.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:15:07.915 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:15:07.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:15:07.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-max-backfills 20 2021-03-30T05:15:07.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:15:07.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:15:07.917 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:15:07.935 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:07.935+0000 7f1ec1f7ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:07.937 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:07.937+0000 7f1ec1f7ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:07.938 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:07.938+0000 7f1ec1f7ff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:08.267 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:15:08.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:15:08.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:15:08.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:15:08.268 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:15:08.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:08.269 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:15:08.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:15:08.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:08.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:15:08.454 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:08.454+0000 7f1ec1f7ff40 -1 Falling back to public interface 2021-03-30T05:15:08.620 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:15:09.194 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:09.194+0000 7f1ec1f7ff40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:15:09.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:15:09.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:09.622 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:15:09.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:15:09.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:09.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:15:09.981 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/67616,v1:127.0.0.1:6811/67616] [v2:127.0.0.1:6812/67616,v1:127.0.0.1:6813/67616] exists,up e9d4aedf-a347-42ac-a899-30a6bdee2a1c 2021-03-30T05:15:09.982 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:15:09.983 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:15:09.983 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:15:09.983 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:757: test_run_osd: get_asok_path osd.1 2021-03-30T05:15:09.983 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2021-03-30T05:15:09.984 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2021-03-30T05:15:09.984 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:09.984 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:09.984 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:09.985 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-osd.1.asok 2021-03-30T05:15:09.985 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:757: test_run_osd: CEPH_ARGS= 2021-03-30T05:15:09.985 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:757: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-osd.1.asok config get osd_max_backfills 2021-03-30T05:15:10.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:757: test_run_osd: local 'backfills={"osd_max_backfills":"20"}' 2021-03-30T05:15:10.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:758: test_run_osd: test '{"osd_max_backfills":"20"}' = '{"osd_max_backfills":"20"}' 2021-03-30T05:15:10.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:760: test_run_osd: CEPH_ARGS='--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30' 2021-03-30T05:15:10.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:760: test_run_osd: run_osd td/ceph-helpers 2 2021-03-30T05:15:10.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:15:10.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:15:10.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2021-03-30T05:15:10.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:15:10.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/2 2021-03-30T05:15:10.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30' 2021-03-30T05:15:10.084 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:15:10.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:15:10.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:15:10.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2021-03-30T05:15:10.085 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2021-03-30T05:15:10.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:15:10.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:15:10.086 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:15:10.086 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:15:10.086 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:10.087 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:10.087 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:10.087 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:10.087 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:10.087 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:10.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:10.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:15:10.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:15:10.088 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:15:10.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:15:10.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:15:10.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:15:10.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:15:10.089 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:10.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:15:10.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:15:10.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/2 2021-03-30T05:15:10.090 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:15:10.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=24c29f49-2a36-461f-b349-dcebff512ca3 2021-03-30T05:15:10.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 24c29f49-2a36-461f-b349-dcebff512ca3' 2021-03-30T05:15:10.091 INFO:tasks.workunit.client.0.smithi197.stdout:add osd2 24c29f49-2a36-461f-b349-dcebff512ca3 2021-03-30T05:15:10.091 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:15:10.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDes2JgGsKeBRAAjiIxih5rqjCMuUVjL0iW2Q== 2021-03-30T05:15:10.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDes2JgGsKeBRAAjiIxih5rqjCMuUVjL0iW2Q=="}' 2021-03-30T05:15:10.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 24c29f49-2a36-461f-b349-dcebff512ca3 -i td/ceph-helpers/2/new.json 2021-03-30T05:15:10.563 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:15:10.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/2/new.json 2021-03-30T05:15:10.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDes2JgGsKeBRAAjiIxih5rqjCMuUVjL0iW2Q== --osd-uuid 24c29f49-2a36-461f-b349-dcebff512ca3 2021-03-30T05:15:10.597 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:10.597+0000 7f84a415af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:10.599 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:10.599+0000 7f84a415af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:10.601 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:10.601+0000 7f84a415af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:10.602 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:10.602+0000 7f84a415af40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:15:10.602 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:10.602+0000 7f84a415af40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:15:10.602 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:10.602+0000 7f84a415af40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:15:10.644 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:10.644+0000 7f84a415af40 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2021-03-30T05:15:11.246 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:11.246+0000 7f84a415af40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:15:13.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/2/keyring 2021-03-30T05:15:13.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:15:13.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2021-03-30T05:15:13.964 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd2 key to auth repository 2021-03-30T05:15:13.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:15:14.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2021-03-30T05:15:14.442 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:15:14.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-max-backfills 30 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:14.443 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:15:14.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:15:14.444 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:15:14.464 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:14.464+0000 7fd94ebdff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:14.466 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:14.466+0000 7fd94ebdff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:14.467 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:14.467+0000 7fd94ebdff40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:14.876 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2021-03-30T05:15:14.876 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:15:14.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:15:14.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:15:14.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:15:14.877 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:14.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:15:14.878 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:15:14.878 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:14.879 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:15:14.984 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:14.984+0000 7fd94ebdff40 -1 Falling back to public interface 2021-03-30T05:15:15.244 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:15:15.744 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:15.744+0000 7fd94ebdff40 -1 osd.2 0 log_to_monitors {default=true} 2021-03-30T05:15:16.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:15:16.246 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:16.246 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:15:16.247 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:15:16.247 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:16.248 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:15:16.607 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/67975,v1:127.0.0.1:6819/67975] [v2:127.0.0.1:6820/67975,v1:127.0.0.1:6821/67975] exists,up 24c29f49-2a36-461f-b349-dcebff512ca3 2021-03-30T05:15:16.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:15:16.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:15:16.609 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:15:16.609 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:762: test_run_osd: get_asok_path osd.2 2021-03-30T05:15:16.610 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2021-03-30T05:15:16.610 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2021-03-30T05:15:16.610 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:16.610 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:16.610 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:16.611 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-osd.2.asok 2021-03-30T05:15:16.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:762: test_run_osd: CEPH_ARGS= 2021-03-30T05:15:16.611 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:762: test_run_osd: ceph --format=json daemon /tmp/ceph-asok.43807/ceph-osd.2.asok config get osd_max_backfills 2021-03-30T05:15:16.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:762: test_run_osd: local 'backfills={"osd_max_backfills":"30"}' 2021-03-30T05:15:16.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:763: test_run_osd: test '{"osd_max_backfills":"30"}' = '{"osd_max_backfills":"30"}' 2021-03-30T05:15:16.702 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:765: test_run_osd: teardown td/ceph-helpers 2021-03-30T05:15:16.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:16.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:16.703 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:16.703 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:16.704 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:16.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:16.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:16.704 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:16.809 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:16.809 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:16.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:16.810 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:16.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:16.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:16.812 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:16.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:16.813 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:16.813 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:16.813 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:16.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:16.814 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:16.815 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:16.818 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:16.818 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:16.818 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:16.818 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:16.821 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:16.821 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:16.821 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:15:16.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_set_config td/ceph-helpers 2021-03-30T05:15:16.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1110: test_set_config: local dir=td/ceph-helpers 2021-03-30T05:15:16.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1112: test_set_config: setup td/ceph-helpers 2021-03-30T05:15:16.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:15:16.822 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:15:16.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:16.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:16.823 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:16.823 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:16.824 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:16.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:16.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:16.824 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:16.825 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:16.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:16.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:16.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:16.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:16.827 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:16.828 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:16.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:16.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:16.828 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:16.829 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:16.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:16.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:16.829 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:16.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:16.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:16.833 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:16.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:16.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:16.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:16.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:15:16.834 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:15:16.834 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:16.834 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:16.834 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:15:16.834 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:15:16.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:15:16.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:15:16.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:15:16.835 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1113: test_set_config: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:15:16.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:15:16.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:15:16.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:15:16.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:15:16.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:15:16.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:15:17.141 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:15:17.142 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:17.142 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:17.142 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:17.142 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.143 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.143 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:17.143 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:15:17.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:15:17.310 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:15:17.310 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:17.311 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:17.311 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:15:17.311 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:15:17.311 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:17.312 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:17.312 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:17.312 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:17.312 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.312 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.313 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:17.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:17.313 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:15:17.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:15:17.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:17.398 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:17.398 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:15:17.398 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:15:17.398 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:17.398 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:17.399 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:17.399 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:17.399 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.399 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.400 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:17.400 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:17.400 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:15:17.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1114: test_set_config: get_config mon a ms_crc_header 2021-03-30T05:15:17.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:17.485 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:17.485 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=ms_crc_header 2021-03-30T05:15:17.485 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .ms_crc_header 2021-03-30T05:15:17.485 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:17.485 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:17.486 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:17.486 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:17.486 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.486 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.487 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:17.487 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:17.487 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get ms_crc_header 2021-03-30T05:15:17.571 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1114: test_set_config: test true = true 2021-03-30T05:15:17.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1115: test_set_config: set_config mon a ms_crc_header false 2021-03-30T05:15:17.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1099: set_config: local daemon=mon 2021-03-30T05:15:17.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1100: set_config: local id=a 2021-03-30T05:15:17.572 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1101: set_config: local config=ms_crc_header 2021-03-30T05:15:17.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1102: set_config: local value=false 2021-03-30T05:15:17.573 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: jq 'has("success")' 2021-03-30T05:15:17.573 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: get_asok_path mon.a 2021-03-30T05:15:17.573 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:17.573 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:17.574 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:17.574 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.574 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.574 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:17.574 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config set ms_crc_header false 2021-03-30T05:15:17.658 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: test true == true 2021-03-30T05:15:17.660 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: test_set_config: get_config mon a ms_crc_header 2021-03-30T05:15:17.660 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:17.660 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:17.661 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=ms_crc_header 2021-03-30T05:15:17.661 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .ms_crc_header 2021-03-30T05:15:17.661 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:17.661 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:17.662 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:17.662 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:17.662 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.662 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.662 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:17.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:17.663 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get ms_crc_header 2021-03-30T05:15:17.747 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: test_set_config: test false = false 2021-03-30T05:15:17.748 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: test_set_config: set_config mon a ms_crc_header true 2021-03-30T05:15:17.748 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1099: set_config: local daemon=mon 2021-03-30T05:15:17.748 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1100: set_config: local id=a 2021-03-30T05:15:17.748 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1101: set_config: local config=ms_crc_header 2021-03-30T05:15:17.749 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1102: set_config: local value=true 2021-03-30T05:15:17.749 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: jq 'has("success")' 2021-03-30T05:15:17.749 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: get_asok_path mon.a 2021-03-30T05:15:17.749 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:17.749 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:17.750 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:17.750 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.750 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.750 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:17.750 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config set ms_crc_header true 2021-03-30T05:15:17.833 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1106: set_config: test true == true 2021-03-30T05:15:17.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: test_set_config: get_config mon a ms_crc_header 2021-03-30T05:15:17.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:17.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:17.836 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=ms_crc_header 2021-03-30T05:15:17.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .ms_crc_header 2021-03-30T05:15:17.837 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:17.837 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:17.837 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:17.838 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:17.838 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:17.838 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:17.838 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:17.839 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:17.839 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get ms_crc_header 2021-03-30T05:15:17.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: test_set_config: test true = true 2021-03-30T05:15:17.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1119: test_set_config: teardown td/ceph-helpers 2021-03-30T05:15:17.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:17.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:17.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:17.922 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:17.922 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:17.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:17.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:17.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:18.025 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:18.025 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:18.026 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:18.027 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:18.027 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:18.028 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:18.028 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:18.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:18.029 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:18.030 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.030 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:18.031 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:18.031 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:18.034 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:18.034 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.034 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:18.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:18.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:18.035 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:15:18.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_setup td/ceph-helpers 2021-03-30T05:15:18.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:144: test_setup: local dir=td/ceph-helpers 2021-03-30T05:15:18.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:145: test_setup: setup td/ceph-helpers 2021-03-30T05:15:18.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:15:18.036 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:15:18.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:18.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:18.037 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:18.037 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:18.037 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:18.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:18.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:18.038 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:18.040 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:18.040 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:18.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:18.041 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:18.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:18.041 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:18.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:18.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:18.042 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:18.042 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:18.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:18.043 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:18.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:18.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.047 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.047 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:18.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:18.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:18.048 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:15:18.048 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:15:18.049 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.049 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:15:18.049 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:15:18.049 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:15:18.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:15:18.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:15:18.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:146: test_setup: test -d td/ceph-helpers 2021-03-30T05:15:18.050 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:147: test_setup: setup td/ceph-helpers 2021-03-30T05:15:18.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:15:18.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:15:18.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:18.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:18.051 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:18.052 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:18.052 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:18.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:18.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:18.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:18.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:18.056 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:18.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:18.056 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:18.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:18.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:18.057 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:18.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:18.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:18.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:18.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:18.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:18.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:18.062 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.063 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:18.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:18.063 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:18.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:15:18.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:15:18.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:15:18.071 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:15:18.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:15:18.071 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:15:18.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:15:18.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:148: test_setup: test -d td/ceph-helpers 2021-03-30T05:15:18.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:149: test_setup: teardown td/ceph-helpers 2021-03-30T05:15:18.072 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:18.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:18.073 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:18.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:18.073 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:18.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:18.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:18.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:18.074 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:18.074 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:18.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:18.075 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:18.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:18.075 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:18.076 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:18.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:18.076 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:18.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:18.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:18.077 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:18.077 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:18.078 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.078 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:18.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:18.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:18.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:15:18.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_teardown td/ceph-helpers 2021-03-30T05:15:18.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:220: test_teardown: local dir=td/ceph-helpers 2021-03-30T05:15:18.079 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:221: test_teardown: setup td/ceph-helpers 2021-03-30T05:15:18.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:15:18.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:15:18.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:18.080 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:18.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:18.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:18.081 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:18.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:18.081 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:18.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:18.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:18.082 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:18.082 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:18.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:18.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:18.083 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:18.083 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:18.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:18.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:18.092 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:18.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:18.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:18.092 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:18.093 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.093 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:18.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:18.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:18.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:15:18.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:15:18.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:15:18.095 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:15:18.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:15:18.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:15:18.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:15:18.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:222: test_teardown: teardown td/ceph-helpers 2021-03-30T05:15:18.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:18.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:18.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:18.097 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:18.097 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:18.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:18.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:18.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:18.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:18.098 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:18.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:18.098 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:18.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:18.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:18.099 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:18.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:18.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:18.100 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:18.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:18.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:18.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:18.101 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:18.101 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:18.101 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:18.101 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:18.101 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:18.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:18.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:223: test_teardown: test -d td/ceph-helpers 2021-03-30T05:15:18.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:15:18.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_wait_background td/ceph-helpers 2021-03-30T05:15:18.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2051: test_wait_background: local pids= 2021-03-30T05:15:18.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2052: test_wait_background: run_in_background pids bash -c 'sleep 1; exit 1' 2021-03-30T05:15:18.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1997: run_in_background: local pid_variable=pids 2021-03-30T05:15:18.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1998: run_in_background: shift 2021-03-30T05:15:18.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: eval 'pids+=" 68419"' 2021-03-30T05:15:18.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: pids+=' 68419' 2021-03-30T05:15:18.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2053: test_wait_background: run_in_background pids bash -c 'sleep 2; exit 0' 2021-03-30T05:15:18.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1997: run_in_background: local pid_variable=pids 2021-03-30T05:15:18.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1998: run_in_background: shift 2021-03-30T05:15:18.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: bash -c 'sleep 1; exit 1' 2021-03-30T05:15:18.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: eval 'pids+=" 68421"' 2021-03-30T05:15:18.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: pids+=' 68421' 2021-03-30T05:15:18.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2054: test_wait_background: wait_background pids 2021-03-30T05:15:18.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2033: wait_background: pids=' 68419 68421' 2021-03-30T05:15:18.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: return_code=0 2021-03-30T05:15:18.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2036: wait_background: for pid in $pids 2021-03-30T05:15:18.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: wait_background: wait 68419 2021-03-30T05:15:18.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sed 's/^/43807: /' 2021-03-30T05:15:18.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: bash -c 'sleep 2; exit 0' 2021-03-30T05:15:18.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sed 's/^/43807: /' 2021-03-30T05:15:19.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: return 1 2021-03-30T05:15:19.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2039: wait_background: return_code=1 2021-03-30T05:15:19.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2036: wait_background: for pid in $pids 2021-03-30T05:15:19.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: wait_background: wait 68421 2021-03-30T05:15:20.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: return 0 2021-03-30T05:15:20.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2044: wait_background: eval 'pids='\'''\''' 2021-03-30T05:15:20.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2044: wait_background: pids= 2021-03-30T05:15:20.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2046: wait_background: return 1 2021-03-30T05:15:20.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2055: test_wait_background: '[' 1 -ne 1 ']' 2021-03-30T05:15:20.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2057: test_wait_background: run_in_background pids bash -c 'sleep 1; exit 0' 2021-03-30T05:15:20.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1997: run_in_background: local pid_variable=pids 2021-03-30T05:15:20.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1998: run_in_background: shift 2021-03-30T05:15:20.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: eval 'pids+=" 68435"' 2021-03-30T05:15:20.095 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: pids+=' 68435' 2021-03-30T05:15:20.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2058: test_wait_background: run_in_background pids bash -c 'sleep 2; exit 0' 2021-03-30T05:15:20.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1997: run_in_background: local pid_variable=pids 2021-03-30T05:15:20.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1998: run_in_background: shift 2021-03-30T05:15:20.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: bash -c 'sleep 1; exit 0' 2021-03-30T05:15:20.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: eval 'pids+=" 68437"' 2021-03-30T05:15:20.096 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2002: run_in_background: pids+=' 68437' 2021-03-30T05:15:20.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2059: test_wait_background: wait_background pids 2021-03-30T05:15:20.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2033: wait_background: pids=' 68435 68437' 2021-03-30T05:15:20.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2035: wait_background: return_code=0 2021-03-30T05:15:20.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2036: wait_background: for pid in $pids 2021-03-30T05:15:20.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: wait_background: wait 68435 2021-03-30T05:15:20.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sed 's/^/43807: /' 2021-03-30T05:15:20.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: bash -c 'sleep 2; exit 0' 2021-03-30T05:15:20.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: sed 's/^/43807: /' 2021-03-30T05:15:21.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: return 0 2021-03-30T05:15:21.193 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2036: wait_background: for pid in $pids 2021-03-30T05:15:21.194 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: wait_background: wait 68437 2021-03-30T05:15:22.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2001: run_in_background: return 0 2021-03-30T05:15:22.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2044: wait_background: eval 'pids='\'''\''' 2021-03-30T05:15:22.097 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2044: wait_background: pids= 2021-03-30T05:15:22.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2046: wait_background: return 0 2021-03-30T05:15:22.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2060: test_wait_background: '[' 0 -ne 0 ']' 2021-03-30T05:15:22.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2062: test_wait_background: '[' '!' -z '' ']' 2021-03-30T05:15:22.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:15:22.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_wait_for_clean td/ceph-helpers 2021-03-30T05:15:22.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1615: test_wait_for_clean: local dir=td/ceph-helpers 2021-03-30T05:15:22.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1617: test_wait_for_clean: setup td/ceph-helpers 2021-03-30T05:15:22.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:15:22.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:15:22.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:22.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:22.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:22.099 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:22.100 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:22.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:22.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:22.100 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:22.101 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:22.102 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:22.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:22.102 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:22.102 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:22.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:22.103 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:22.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:22.103 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:22.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:22.104 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:22.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:22.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:22.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:22.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:22.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:22.107 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:22.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:22.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:22.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:22.108 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:15:22.108 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:15:22.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:22.109 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:22.109 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:15:22.111 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:15:22.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:15:22.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:15:22.111 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:15:22.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1618: test_wait_for_clean: run_mon td/ceph-helpers a --osd_pool_default_size=2 2021-03-30T05:15:22.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:15:22.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:15:22.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:15:22.112 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:15:22.113 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:15:22.113 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2021-03-30T05:15:22.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:15:22.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:22.438 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:22.438 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:22.438 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:22.438 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:22.439 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:22.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2021-03-30T05:15:22.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:15:22.656 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:15:22.656 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:22.657 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:22.657 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:15:22.657 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:15:22.658 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:22.659 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:22.659 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:22.659 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:22.659 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:22.660 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:22.660 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:22.660 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:22.660 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:15:22.755 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:15:22.755 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:22.756 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:22.756 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:15:22.756 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:15:22.756 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:22.757 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:22.757 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:22.757 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:22.757 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:22.757 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:22.757 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:22.758 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:22.758 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:15:22.847 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1619: test_wait_for_clean: run_osd td/ceph-helpers 0 2021-03-30T05:15:22.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:15:22.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:15:22.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:15:22.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:15:22.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:15:22.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:15:22.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:15:22.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:15:22.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:15:22.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:15:22.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:15:22.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:15:22.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:15:22.851 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:15:22.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:15:22.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:22.851 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:22.851 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:22.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:22.852 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:22.852 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:22.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:22.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:15:22.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:15:22.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:15:22.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:15:22.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:15:22.853 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:15:22.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:15:22.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:22.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:15:22.854 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:15:22.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:15:22.855 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:15:22.855 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=7c88b84d-ce4a-40da-90e1-b9e0d1b5c144 2021-03-30T05:15:22.855 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 7c88b84d-ce4a-40da-90e1-b9e0d1b5c144 2021-03-30T05:15:22.856 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 7c88b84d-ce4a-40da-90e1-b9e0d1b5c144' 2021-03-30T05:15:22.856 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:15:22.860 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQDqs2JgmNlKMxAAimcGsAOeub9X5bYffv6FFg== 2021-03-30T05:15:22.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQDqs2JgmNlKMxAAimcGsAOeub9X5bYffv6FFg=="}' 2021-03-30T05:15:22.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 7c88b84d-ce4a-40da-90e1-b9e0d1b5c144 -i td/ceph-helpers/0/new.json 2021-03-30T05:15:23.372 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:15:23.381 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:15:23.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDqs2JgmNlKMxAAimcGsAOeub9X5bYffv6FFg== --osd-uuid 7c88b84d-ce4a-40da-90e1-b9e0d1b5c144 2021-03-30T05:15:23.404 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.403+0000 7fb5baff9f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:23.405 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.405+0000 7fb5baff9f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:23.406 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.406+0000 7fb5baff9f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:23.407 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.406+0000 7fb5baff9f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:15:23.407 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.406+0000 7fb5baff9f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:15:23.407 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.406+0000 7fb5baff9f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:15:23.445 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.445+0000 7fb5baff9f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:15:23.922 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:23.922+0000 7fb5baff9f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:15:26.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:15:26.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:15:26.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:15:26.655 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:15:26.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:15:26.883 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:15:26.883 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:15:26.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:26.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:15:26.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:15:26.885 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:15:26.903 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:26.903+0000 7f8e5107af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:26.905 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:26.905+0000 7f8e5107af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:26.906 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:26.906+0000 7f8e5107af40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:27.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:15:27.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:15:27.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:15:27.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:15:27.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:15:27.094 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:27.094 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:15:27.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:15:27.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:27.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:15:27.320 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:15:27.422 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:27.422+0000 7f8e5107af40 -1 Falling back to public interface 2021-03-30T05:15:28.159 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:28.159+0000 7f8e5107af40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:15:28.321 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:15:28.322 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:28.322 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:15:28.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:15:28.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:28.323 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:15:28.577 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:15:29.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:15:29.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:29.579 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:15:29.580 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:15:29.580 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:29.581 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:15:29.789 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/68719,v1:127.0.0.1:6801/68719] [v2:127.0.0.1:6802/68719,v1:127.0.0.1:6803/68719] exists,up 7c88b84d-ce4a-40da-90e1-b9e0d1b5c144 2021-03-30T05:15:29.790 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:15:29.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:15:29.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:15:29.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1620: test_wait_for_clean: run_mgr td/ceph-helpers x 2021-03-30T05:15:29.791 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:15:29.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:15:29.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:15:29.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:15:29.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:15:29.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:15:30.056 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:15:30.057 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:30.057 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:30.057 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:30.057 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:30.057 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:30.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:30.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:15:30.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:15:30.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1621: test_wait_for_clean: create_rbd_pool 2021-03-30T05:15:30.078 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:15:30.293 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:15:30.301 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:15:30.302 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:15:30.652 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:15:30.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:15:31.661 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:15:32.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1622: test_wait_for_clean: WAIT_FOR_CLEAN_TIMEOUT=1 2021-03-30T05:15:32.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1622: test_wait_for_clean: wait_for_clean 2021-03-30T05:15:32.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:15:32.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:15:32.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:15:32.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:15:32.606 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 1 .1 2021-03-30T05:15:32.606 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:15:32.607 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:15:32.607 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:15:32.607 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:15:32.607 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:15:32.631 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:15:32.631 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:15:32.631 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:15:32.632 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:15:32.632 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:15:32.858 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:15:32.859 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:15:32.859 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:15:32.859 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:15:32.987 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=0 2021-03-30T05:15:32.987 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 0 2021-03-30T05:15:32.988 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-0' 2021-03-30T05:15:32.988 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:15:32.988 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-0 2021-03-30T05:15:32.988 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:15:32.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:15:32.989 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-0 2021-03-30T05:15:32.990 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:15:32.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=0 2021-03-30T05:15:32.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 0' 2021-03-30T05:15:32.990 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 0 2021-03-30T05:15:32.991 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:15:33.231 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 0 -lt 0 2021-03-30T05:15:33.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:15:33.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:33.232 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:33.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 0 == 0 2021-03-30T05:15:33.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: wait_for_clean: sleep 1 2021-03-30T05:15:34.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:15:34.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:34.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:34.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:15:34.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:34.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:34.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:34.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:34.925 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:34.925 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:34.925 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:35.266 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:15:35.266 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:35.267 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:35.267 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:35.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:15:35.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2021-03-30T05:15:35.730 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2021-03-30T05:15:35.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2021-03-30T05:15:35.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:15:35.731 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2021-03-30T05:15:35.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:15:35.831 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:35.831 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:35.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:35.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:35.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:35.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:35.832 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:36.171 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:15:36.172 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:36.172 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:36.172 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:36.634 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:15:36.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:15:36.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:15:36.635 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:15:36.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:15:36.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:15:36.636 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:15:36.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:15:36.636 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:15:37.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:15:37.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:15:37.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 4 )) 2021-03-30T05:15:37.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:15:37.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2021-03-30T05:15:37.298 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:15:37.299 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:37.299 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:37.299 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:37.300 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:37.300 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:37.300 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:37.300 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:37.637 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:15:37.637 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:37.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:37.638 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:38.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:15:38.130 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:15:38.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:15:38.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:15:38.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:15:38.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:15:38.131 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:15:38.132 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:15:38.132 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:15:38.596 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:15:38.596 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:15:38.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 4 )) 2021-03-30T05:15:38.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:15:38.597 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2021-03-30T05:15:38.997 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:15:38.998 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:38.998 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:38.998 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:38.999 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:38.999 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:38.999 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:38.999 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:39.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:15:39.339 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:39.339 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:39.339 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:39.825 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:15:39.825 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:15:39.825 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:15:39.826 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:15:39.826 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:15:39.826 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:15:39.826 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:15:39.826 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:15:39.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:15:40.286 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:15:40.287 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:15:40.287 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 4 )) 2021-03-30T05:15:40.287 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:15:40.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.3 2021-03-30T05:15:40.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:15:40.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:40.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:40.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:40.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:40.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:40.589 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:40.590 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:40.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:15:40.930 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:40.931 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:40.931 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:41.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:15:41.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:15:41.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:15:41.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:15:41.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:15:41.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:15:41.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:15:41.398 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:15:41.398 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:15:41.861 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:15:41.862 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:15:41.862 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 4 )) 2021-03-30T05:15:41.863 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2021-03-30T05:15:42.323 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:15:42.324 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_fingerprint": "2b49c328-554a-4f84-85ee-e4f305ccd4a1", 2021-03-30T05:15:42.324 INFO:tasks.workunit.client.0.smithi197.stdout: "version": "15.2.10-14-ge4949d65", 2021-03-30T05:15:42.324 INFO:tasks.workunit.client.0.smithi197.stdout: "commit": "e4949d651265114d7b464cd1e8986d9a31a26071", 2021-03-30T05:15:42.324 INFO:tasks.workunit.client.0.smithi197.stdout: "timestamp": "2021-03-30T05:15:42.322437+0000", 2021-03-30T05:15:42.324 INFO:tasks.workunit.client.0.smithi197.stdout: "tag": "", 2021-03-30T05:15:42.325 INFO:tasks.workunit.client.0.smithi197.stdout: "health": { 2021-03-30T05:15:42.325 INFO:tasks.workunit.client.0.smithi197.stdout: "status": "HEALTH_WARN", 2021-03-30T05:15:42.325 INFO:tasks.workunit.client.0.smithi197.stdout: "checks": { 2021-03-30T05:15:42.325 INFO:tasks.workunit.client.0.smithi197.stdout: "PG_DEGRADED": { 2021-03-30T05:15:42.326 INFO:tasks.workunit.client.0.smithi197.stdout: "severity": "HEALTH_WARN", 2021-03-30T05:15:42.326 INFO:tasks.workunit.client.0.smithi197.stdout: "summary": { 2021-03-30T05:15:42.326 INFO:tasks.workunit.client.0.smithi197.stdout: "message": "Degraded data redundancy: 1/2 objects degraded (50.000%), 1 pg degraded", 2021-03-30T05:15:42.326 INFO:tasks.workunit.client.0.smithi197.stdout: "count": 1 2021-03-30T05:15:42.326 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.327 INFO:tasks.workunit.client.0.smithi197.stdout: "detail": [ 2021-03-30T05:15:42.327 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.327 INFO:tasks.workunit.client.0.smithi197.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0]" 2021-03-30T05:15:42.327 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.327 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.328 INFO:tasks.workunit.client.0.smithi197.stdout: "muted": false 2021-03-30T05:15:42.328 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.328 INFO:tasks.workunit.client.0.smithi197.stdout: "TOO_FEW_OSDS": { 2021-03-30T05:15:42.328 INFO:tasks.workunit.client.0.smithi197.stdout: "severity": "HEALTH_WARN", 2021-03-30T05:15:42.329 INFO:tasks.workunit.client.0.smithi197.stdout: "summary": { 2021-03-30T05:15:42.329 INFO:tasks.workunit.client.0.smithi197.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2021-03-30T05:15:42.329 INFO:tasks.workunit.client.0.smithi197.stdout: "count": 2 2021-03-30T05:15:42.329 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.329 INFO:tasks.workunit.client.0.smithi197.stdout: "detail": [], 2021-03-30T05:15:42.330 INFO:tasks.workunit.client.0.smithi197.stdout: "muted": false 2021-03-30T05:15:42.330 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.330 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.330 INFO:tasks.workunit.client.0.smithi197.stdout: "mutes": [] 2021-03-30T05:15:42.330 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.331 INFO:tasks.workunit.client.0.smithi197.stdout: "monmap_first_committed": 1, 2021-03-30T05:15:42.331 INFO:tasks.workunit.client.0.smithi197.stdout: "monmap_last_committed": 1, 2021-03-30T05:15:42.331 INFO:tasks.workunit.client.0.smithi197.stdout: "monmap": { 2021-03-30T05:15:42.331 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 1, 2021-03-30T05:15:42.332 INFO:tasks.workunit.client.0.smithi197.stdout: "fsid": "56d309ad-176e-4c93-a3be-41f06f3ac8af", 2021-03-30T05:15:42.332 INFO:tasks.workunit.client.0.smithi197.stdout: "modified": "2021-03-30T05:15:22.131052Z", 2021-03-30T05:15:42.332 INFO:tasks.workunit.client.0.smithi197.stdout: "created": "2021-03-30T05:15:22.131052Z", 2021-03-30T05:15:42.332 INFO:tasks.workunit.client.0.smithi197.stdout: "min_mon_release": 15, 2021-03-30T05:15:42.332 INFO:tasks.workunit.client.0.smithi197.stdout: "min_mon_release_name": "octopus", 2021-03-30T05:15:42.333 INFO:tasks.workunit.client.0.smithi197.stdout: "features": { 2021-03-30T05:15:42.333 INFO:tasks.workunit.client.0.smithi197.stdout: "persistent": [ 2021-03-30T05:15:42.333 INFO:tasks.workunit.client.0.smithi197.stdout: "kraken", 2021-03-30T05:15:42.333 INFO:tasks.workunit.client.0.smithi197.stdout: "luminous", 2021-03-30T05:15:42.334 INFO:tasks.workunit.client.0.smithi197.stdout: "mimic", 2021-03-30T05:15:42.334 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap-prune", 2021-03-30T05:15:42.334 INFO:tasks.workunit.client.0.smithi197.stdout: "nautilus", 2021-03-30T05:15:42.334 INFO:tasks.workunit.client.0.smithi197.stdout: "octopus" 2021-03-30T05:15:42.335 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.335 INFO:tasks.workunit.client.0.smithi197.stdout: "optional": [] 2021-03-30T05:15:42.335 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.335 INFO:tasks.workunit.client.0.smithi197.stdout: "mons": [ 2021-03-30T05:15:42.335 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.336 INFO:tasks.workunit.client.0.smithi197.stdout: "rank": 0, 2021-03-30T05:15:42.336 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "a", 2021-03-30T05:15:42.336 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addrs": { 2021-03-30T05:15:42.336 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:15:42.337 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.337 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:15:42.337 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:7109", 2021-03-30T05:15:42.337 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 0 2021-03-30T05:15:42.337 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.338 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.338 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.338 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:7109/0", 2021-03-30T05:15:42.338 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addr": "127.0.0.1:7109/0", 2021-03-30T05:15:42.339 INFO:tasks.workunit.client.0.smithi197.stdout: "priority": 0, 2021-03-30T05:15:42.339 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 0 2021-03-30T05:15:42.339 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.339 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.340 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.340 INFO:tasks.workunit.client.0.smithi197.stdout: "quorum": [ 2021-03-30T05:15:42.340 INFO:tasks.workunit.client.0.smithi197.stdout: 0 2021-03-30T05:15:42.340 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.340 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap": { 2021-03-30T05:15:42.341 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 12, 2021-03-30T05:15:42.341 INFO:tasks.workunit.client.0.smithi197.stdout: "fsid": "56d309ad-176e-4c93-a3be-41f06f3ac8af", 2021-03-30T05:15:42.341 INFO:tasks.workunit.client.0.smithi197.stdout: "created": "2021-03-30T05:15:22.935457+0000", 2021-03-30T05:15:42.341 INFO:tasks.workunit.client.0.smithi197.stdout: "modified": "2021-03-30T05:15:32.322356+0000", 2021-03-30T05:15:42.341 INFO:tasks.workunit.client.0.smithi197.stdout: "last_up_change": "2021-03-30T05:15:28.672696+0000", 2021-03-30T05:15:42.342 INFO:tasks.workunit.client.0.smithi197.stdout: "last_in_change": "2021-03-30T05:15:28.672696+0000", 2021-03-30T05:15:42.342 INFO:tasks.workunit.client.0.smithi197.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-03-30T05:15:42.342 INFO:tasks.workunit.client.0.smithi197.stdout: "flags_num": 5799936, 2021-03-30T05:15:42.342 INFO:tasks.workunit.client.0.smithi197.stdout: "flags_set": [ 2021-03-30T05:15:42.343 INFO:tasks.workunit.client.0.smithi197.stdout: "pglog_hardlimit", 2021-03-30T05:15:42.343 INFO:tasks.workunit.client.0.smithi197.stdout: "purged_snapdirs", 2021-03-30T05:15:42.343 INFO:tasks.workunit.client.0.smithi197.stdout: "recovery_deletes", 2021-03-30T05:15:42.343 INFO:tasks.workunit.client.0.smithi197.stdout: "sortbitwise" 2021-03-30T05:15:42.343 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.344 INFO:tasks.workunit.client.0.smithi197.stdout: "crush_version": 3, 2021-03-30T05:15:42.344 INFO:tasks.workunit.client.0.smithi197.stdout: "full_ratio": 0.99000000953674316, 2021-03-30T05:15:42.344 INFO:tasks.workunit.client.0.smithi197.stdout: "backfillfull_ratio": 0.99000000953674316, 2021-03-30T05:15:42.344 INFO:tasks.workunit.client.0.smithi197.stdout: "nearfull_ratio": 0.85000002384185791, 2021-03-30T05:15:42.345 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_snapshot": "", 2021-03-30T05:15:42.345 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_max": 1, 2021-03-30T05:15:42.345 INFO:tasks.workunit.client.0.smithi197.stdout: "max_osd": 1, 2021-03-30T05:15:42.345 INFO:tasks.workunit.client.0.smithi197.stdout: "require_min_compat_client": "jewel", 2021-03-30T05:15:42.345 INFO:tasks.workunit.client.0.smithi197.stdout: "min_compat_client": "jewel", 2021-03-30T05:15:42.346 INFO:tasks.workunit.client.0.smithi197.stdout: "require_osd_release": "octopus", 2021-03-30T05:15:42.346 INFO:tasks.workunit.client.0.smithi197.stdout: "pools": [ 2021-03-30T05:15:42.346 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.346 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": 1, 2021-03-30T05:15:42.346 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_name": "rbd", 2021-03-30T05:15:42.347 INFO:tasks.workunit.client.0.smithi197.stdout: "create_time": "2021-03-30T05:15:30.478846+0000", 2021-03-30T05:15:42.347 INFO:tasks.workunit.client.0.smithi197.stdout: "flags": 8193, 2021-03-30T05:15:42.347 INFO:tasks.workunit.client.0.smithi197.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2021-03-30T05:15:42.347 INFO:tasks.workunit.client.0.smithi197.stdout: "type": 1, 2021-03-30T05:15:42.348 INFO:tasks.workunit.client.0.smithi197.stdout: "size": 2, 2021-03-30T05:15:42.348 INFO:tasks.workunit.client.0.smithi197.stdout: "min_size": 1, 2021-03-30T05:15:42.348 INFO:tasks.workunit.client.0.smithi197.stdout: "crush_rule": 0, 2021-03-30T05:15:42.348 INFO:tasks.workunit.client.0.smithi197.stdout: "object_hash": 2, 2021-03-30T05:15:42.348 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_autoscale_mode": "off", 2021-03-30T05:15:42.349 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_num": 4, 2021-03-30T05:15:42.349 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_placement_num": 4, 2021-03-30T05:15:42.349 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_placement_num_target": 4, 2021-03-30T05:15:42.349 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_num_target": 4, 2021-03-30T05:15:42.349 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_num_pending": 4, 2021-03-30T05:15:42.350 INFO:tasks.workunit.client.0.smithi197.stdout: "last_pg_merge_meta": { 2021-03-30T05:15:42.350 INFO:tasks.workunit.client.0.smithi197.stdout: "source_pgid": "0.0", 2021-03-30T05:15:42.350 INFO:tasks.workunit.client.0.smithi197.stdout: "ready_epoch": 0, 2021-03-30T05:15:42.350 INFO:tasks.workunit.client.0.smithi197.stdout: "last_epoch_started": 0, 2021-03-30T05:15:42.350 INFO:tasks.workunit.client.0.smithi197.stdout: "last_epoch_clean": 0, 2021-03-30T05:15:42.351 INFO:tasks.workunit.client.0.smithi197.stdout: "source_version": "0'0", 2021-03-30T05:15:42.351 INFO:tasks.workunit.client.0.smithi197.stdout: "target_version": "0'0" 2021-03-30T05:15:42.351 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.351 INFO:tasks.workunit.client.0.smithi197.stdout: "last_change": "12", 2021-03-30T05:15:42.352 INFO:tasks.workunit.client.0.smithi197.stdout: "last_force_op_resend": "0", 2021-03-30T05:15:42.352 INFO:tasks.workunit.client.0.smithi197.stdout: "last_force_op_resend_prenautilus": "0", 2021-03-30T05:15:42.352 INFO:tasks.workunit.client.0.smithi197.stdout: "last_force_op_resend_preluminous": "0", 2021-03-30T05:15:42.352 INFO:tasks.workunit.client.0.smithi197.stdout: "auid": 0, 2021-03-30T05:15:42.352 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_mode": "selfmanaged", 2021-03-30T05:15:42.353 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_seq": 3, 2021-03-30T05:15:42.353 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_epoch": 12, 2021-03-30T05:15:42.353 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_snaps": [], 2021-03-30T05:15:42.353 INFO:tasks.workunit.client.0.smithi197.stdout: "removed_snaps": "[]", 2021-03-30T05:15:42.353 INFO:tasks.workunit.client.0.smithi197.stdout: "quota_max_bytes": 0, 2021-03-30T05:15:42.354 INFO:tasks.workunit.client.0.smithi197.stdout: "quota_max_objects": 0, 2021-03-30T05:15:42.354 INFO:tasks.workunit.client.0.smithi197.stdout: "tiers": [], 2021-03-30T05:15:42.354 INFO:tasks.workunit.client.0.smithi197.stdout: "tier_of": -1, 2021-03-30T05:15:42.354 INFO:tasks.workunit.client.0.smithi197.stdout: "read_tier": -1, 2021-03-30T05:15:42.355 INFO:tasks.workunit.client.0.smithi197.stdout: "write_tier": -1, 2021-03-30T05:15:42.355 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_mode": "none", 2021-03-30T05:15:42.355 INFO:tasks.workunit.client.0.smithi197.stdout: "target_max_bytes": 0, 2021-03-30T05:15:42.355 INFO:tasks.workunit.client.0.smithi197.stdout: "target_max_objects": 0, 2021-03-30T05:15:42.355 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-03-30T05:15:42.356 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-03-30T05:15:42.356 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_target_full_ratio_micro": 800000, 2021-03-30T05:15:42.356 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_min_flush_age": 0, 2021-03-30T05:15:42.356 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_min_evict_age": 0, 2021-03-30T05:15:42.356 INFO:tasks.workunit.client.0.smithi197.stdout: "erasure_code_profile": "", 2021-03-30T05:15:42.357 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_params": { 2021-03-30T05:15:42.357 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "none" 2021-03-30T05:15:42.357 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.357 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_period": 0, 2021-03-30T05:15:42.357 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_count": 0, 2021-03-30T05:15:42.358 INFO:tasks.workunit.client.0.smithi197.stdout: "use_gmt_hitset": true, 2021-03-30T05:15:42.358 INFO:tasks.workunit.client.0.smithi197.stdout: "min_read_recency_for_promote": 0, 2021-03-30T05:15:42.358 INFO:tasks.workunit.client.0.smithi197.stdout: "min_write_recency_for_promote": 0, 2021-03-30T05:15:42.358 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_grade_decay_rate": 0, 2021-03-30T05:15:42.359 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_search_last_n": 0, 2021-03-30T05:15:42.359 INFO:tasks.workunit.client.0.smithi197.stdout: "grade_table": [], 2021-03-30T05:15:42.359 INFO:tasks.workunit.client.0.smithi197.stdout: "stripe_width": 0, 2021-03-30T05:15:42.359 INFO:tasks.workunit.client.0.smithi197.stdout: "expected_num_objects": 0, 2021-03-30T05:15:42.359 INFO:tasks.workunit.client.0.smithi197.stdout: "fast_read": false, 2021-03-30T05:15:42.360 INFO:tasks.workunit.client.0.smithi197.stdout: "options": {}, 2021-03-30T05:15:42.360 INFO:tasks.workunit.client.0.smithi197.stdout: "application_metadata": { 2021-03-30T05:15:42.360 INFO:tasks.workunit.client.0.smithi197.stdout: "rbd": {} 2021-03-30T05:15:42.360 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.360 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.361 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.361 INFO:tasks.workunit.client.0.smithi197.stdout: "osds": [ 2021-03-30T05:15:42.361 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.361 INFO:tasks.workunit.client.0.smithi197.stdout: "osd": 0, 2021-03-30T05:15:42.361 INFO:tasks.workunit.client.0.smithi197.stdout: "uuid": "7c88b84d-ce4a-40da-90e1-b9e0d1b5c144", 2021-03-30T05:15:42.362 INFO:tasks.workunit.client.0.smithi197.stdout: "up": 1, 2021-03-30T05:15:42.362 INFO:tasks.workunit.client.0.smithi197.stdout: "in": 1, 2021-03-30T05:15:42.362 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 1, 2021-03-30T05:15:42.362 INFO:tasks.workunit.client.0.smithi197.stdout: "primary_affinity": 1, 2021-03-30T05:15:42.363 INFO:tasks.workunit.client.0.smithi197.stdout: "last_clean_begin": 0, 2021-03-30T05:15:42.363 INFO:tasks.workunit.client.0.smithi197.stdout: "last_clean_end": 0, 2021-03-30T05:15:42.363 INFO:tasks.workunit.client.0.smithi197.stdout: "up_from": 5, 2021-03-30T05:15:42.363 INFO:tasks.workunit.client.0.smithi197.stdout: "up_thru": 7, 2021-03-30T05:15:42.363 INFO:tasks.workunit.client.0.smithi197.stdout: "down_at": 0, 2021-03-30T05:15:42.364 INFO:tasks.workunit.client.0.smithi197.stdout: "lost_at": 0, 2021-03-30T05:15:42.364 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addrs": { 2021-03-30T05:15:42.364 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:15:42.364 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.364 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:15:42.365 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6800", 2021-03-30T05:15:42.365 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.365 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.365 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.365 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:15:42.366 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6801", 2021-03-30T05:15:42.366 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.366 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.366 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.367 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.367 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_addrs": { 2021-03-30T05:15:42.367 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:15:42.367 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.367 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:15:42.368 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6802", 2021-03-30T05:15:42.368 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.368 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.368 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.368 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:15:42.369 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6803", 2021-03-30T05:15:42.369 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.369 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.369 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.369 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.370 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_back_addrs": { 2021-03-30T05:15:42.370 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:15:42.370 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.370 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:15:42.370 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6806", 2021-03-30T05:15:42.371 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.371 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.371 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.371 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:15:42.372 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6807", 2021-03-30T05:15:42.372 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.372 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.372 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.372 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.373 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_front_addrs": { 2021-03-30T05:15:42.373 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:15:42.373 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.373 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:15:42.373 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6804", 2021-03-30T05:15:42.374 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.374 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.374 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.374 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:15:42.375 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6805", 2021-03-30T05:15:42.375 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 68719 2021-03-30T05:15:42.375 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.375 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.375 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.376 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addr": "127.0.0.1:6801/68719", 2021-03-30T05:15:42.376 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_addr": "127.0.0.1:6803/68719", 2021-03-30T05:15:42.376 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_back_addr": "127.0.0.1:6807/68719", 2021-03-30T05:15:42.376 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_front_addr": "127.0.0.1:6805/68719", 2021-03-30T05:15:42.377 INFO:tasks.workunit.client.0.smithi197.stdout: "state": [ 2021-03-30T05:15:42.377 INFO:tasks.workunit.client.0.smithi197.stdout: "exists", 2021-03-30T05:15:42.377 INFO:tasks.workunit.client.0.smithi197.stdout: "up" 2021-03-30T05:15:42.377 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.377 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.378 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.378 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_xinfo": [ 2021-03-30T05:15:42.378 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.378 INFO:tasks.workunit.client.0.smithi197.stdout: "osd": 0, 2021-03-30T05:15:42.378 INFO:tasks.workunit.client.0.smithi197.stdout: "down_stamp": "0.000000", 2021-03-30T05:15:42.379 INFO:tasks.workunit.client.0.smithi197.stdout: "laggy_probability": 0, 2021-03-30T05:15:42.379 INFO:tasks.workunit.client.0.smithi197.stdout: "laggy_interval": 0, 2021-03-30T05:15:42.379 INFO:tasks.workunit.client.0.smithi197.stdout: "features": 4540138292840890367, 2021-03-30T05:15:42.379 INFO:tasks.workunit.client.0.smithi197.stdout: "old_weight": 0, 2021-03-30T05:15:42.380 INFO:tasks.workunit.client.0.smithi197.stdout: "last_purged_snaps_scrub": "2021-03-30T05:15:29.169005+0000", 2021-03-30T05:15:42.380 INFO:tasks.workunit.client.0.smithi197.stdout: "dead_epoch": 0 2021-03-30T05:15:42.380 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.380 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.380 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_upmap": [], 2021-03-30T05:15:42.381 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_upmap_items": [], 2021-03-30T05:15:42.381 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_temp": [], 2021-03-30T05:15:42.381 INFO:tasks.workunit.client.0.smithi197.stdout: "primary_temp": [], 2021-03-30T05:15:42.381 INFO:tasks.workunit.client.0.smithi197.stdout: "blacklist": {}, 2021-03-30T05:15:42.381 INFO:tasks.workunit.client.0.smithi197.stdout: "erasure_code_profiles": { 2021-03-30T05:15:42.382 INFO:tasks.workunit.client.0.smithi197.stdout: "default": { 2021-03-30T05:15:42.382 INFO:tasks.workunit.client.0.smithi197.stdout: "k": "2", 2021-03-30T05:15:42.382 INFO:tasks.workunit.client.0.smithi197.stdout: "m": "2", 2021-03-30T05:15:42.382 INFO:tasks.workunit.client.0.smithi197.stdout: "plugin": "jerasure", 2021-03-30T05:15:42.382 INFO:tasks.workunit.client.0.smithi197.stdout: "technique": "reed_sol_van" 2021-03-30T05:15:42.383 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.383 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.383 INFO:tasks.workunit.client.0.smithi197.stdout: "removed_snaps_queue": [ 2021-03-30T05:15:42.383 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.384 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": 1, 2021-03-30T05:15:42.384 INFO:tasks.workunit.client.0.smithi197.stdout: "snaps": [ 2021-03-30T05:15:42.384 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.384 INFO:tasks.workunit.client.0.smithi197.stdout: "begin": 2, 2021-03-30T05:15:42.384 INFO:tasks.workunit.client.0.smithi197.stdout: "length": 1 2021-03-30T05:15:42.385 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.385 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.385 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.385 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.385 INFO:tasks.workunit.client.0.smithi197.stdout: "new_removed_snaps": [ 2021-03-30T05:15:42.386 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.386 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": 1, 2021-03-30T05:15:42.386 INFO:tasks.workunit.client.0.smithi197.stdout: "snaps": [ 2021-03-30T05:15:42.386 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.386 INFO:tasks.workunit.client.0.smithi197.stdout: "begin": 2, 2021-03-30T05:15:42.387 INFO:tasks.workunit.client.0.smithi197.stdout: "length": 1 2021-03-30T05:15:42.387 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.387 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.387 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.387 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.388 INFO:tasks.workunit.client.0.smithi197.stdout: "new_purged_snaps": [], 2021-03-30T05:15:42.388 INFO:tasks.workunit.client.0.smithi197.stdout: "crush_node_flags": {}, 2021-03-30T05:15:42.388 INFO:tasks.workunit.client.0.smithi197.stdout: "device_class_flags": {} 2021-03-30T05:15:42.388 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.389 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_metadata": [ 2021-03-30T05:15:42.389 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.389 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:15:42.389 INFO:tasks.workunit.client.0.smithi197.stdout: "arch": "x86_64", 2021-03-30T05:15:42.389 INFO:tasks.workunit.client.0.smithi197.stdout: "back_addr": "[v2:127.0.0.1:6802/68719,v1:127.0.0.1:6803/68719]", 2021-03-30T05:15:42.390 INFO:tasks.workunit.client.0.smithi197.stdout: "back_iface": "", 2021-03-30T05:15:42.390 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs": "1", 2021-03-30T05:15:42.390 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs_dedicated_db": "0", 2021-03-30T05:15:42.390 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs_dedicated_wal": "0", 2021-03-30T05:15:42.390 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs_single_shared_device": "1", 2021-03-30T05:15:42.391 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_access_mode": "file", 2021-03-30T05:15:42.391 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_block_size": "4096", 2021-03-30T05:15:42.391 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_devices": "sda", 2021-03-30T05:15:42.391 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_driver": "KernelDevice", 2021-03-30T05:15:42.392 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2021-03-30T05:15:42.392 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_rotational": "1", 2021-03-30T05:15:42.392 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_size": "107374182400", 2021-03-30T05:15:42.392 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_support_discard": "0", 2021-03-30T05:15:42.392 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_type": "hdd", 2021-03-30T05:15:42.393 INFO:tasks.workunit.client.0.smithi197.stdout: "ceph_release": "octopus", 2021-03-30T05:15:42.393 INFO:tasks.workunit.client.0.smithi197.stdout: "ceph_version": "ceph version 15.2.10-14-ge4949d65 (e4949d651265114d7b464cd1e8986d9a31a26071) octopus (stable)", 2021-03-30T05:15:42.393 INFO:tasks.workunit.client.0.smithi197.stdout: "ceph_version_short": "15.2.10-14-ge4949d65", 2021-03-30T05:15:42.393 INFO:tasks.workunit.client.0.smithi197.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-03-30T05:15:42.393 INFO:tasks.workunit.client.0.smithi197.stdout: "default_device_class": "hdd", 2021-03-30T05:15:42.394 INFO:tasks.workunit.client.0.smithi197.stdout: "device_ids": "sda=ST1000NM0033-9ZM_Z1W5XK3R", 2021-03-30T05:15:42.394 INFO:tasks.workunit.client.0.smithi197.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2021-03-30T05:15:42.394 INFO:tasks.workunit.client.0.smithi197.stdout: "devices": "sda", 2021-03-30T05:15:42.394 INFO:tasks.workunit.client.0.smithi197.stdout: "distro": "rhel", 2021-03-30T05:15:42.395 INFO:tasks.workunit.client.0.smithi197.stdout: "distro_description": "Red Hat Enterprise Linux 8.2 (Ootpa)", 2021-03-30T05:15:42.395 INFO:tasks.workunit.client.0.smithi197.stdout: "distro_version": "8.2", 2021-03-30T05:15:42.395 INFO:tasks.workunit.client.0.smithi197.stdout: "front_addr": "[v2:127.0.0.1:6800/68719,v1:127.0.0.1:6801/68719]", 2021-03-30T05:15:42.395 INFO:tasks.workunit.client.0.smithi197.stdout: "front_iface": "", 2021-03-30T05:15:42.395 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/68719,v1:127.0.0.1:6807/68719]", 2021-03-30T05:15:42.396 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/68719,v1:127.0.0.1:6805/68719]", 2021-03-30T05:15:42.396 INFO:tasks.workunit.client.0.smithi197.stdout: "hostname": "smithi197", 2021-03-30T05:15:42.396 INFO:tasks.workunit.client.0.smithi197.stdout: "journal_rotational": "1", 2021-03-30T05:15:42.396 INFO:tasks.workunit.client.0.smithi197.stdout: "kernel_description": "#1 SMP Wed Feb 3 03:12:15 EST 2021", 2021-03-30T05:15:42.396 INFO:tasks.workunit.client.0.smithi197.stdout: "kernel_version": "4.18.0-240.15.1.el8_3.x86_64", 2021-03-30T05:15:42.397 INFO:tasks.workunit.client.0.smithi197.stdout: "mem_swap_kb": "0", 2021-03-30T05:15:42.397 INFO:tasks.workunit.client.0.smithi197.stdout: "mem_total_kb": "32612076", 2021-03-30T05:15:42.397 INFO:tasks.workunit.client.0.smithi197.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2021-03-30T05:15:42.397 INFO:tasks.workunit.client.0.smithi197.stdout: "objectstore_numa_unknown_devices": "sda", 2021-03-30T05:15:42.397 INFO:tasks.workunit.client.0.smithi197.stdout: "os": "Linux", 2021-03-30T05:15:42.398 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_data": "td/ceph-helpers/0", 2021-03-30T05:15:42.398 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_objectstore": "bluestore", 2021-03-30T05:15:42.398 INFO:tasks.workunit.client.0.smithi197.stdout: "osdspec_affinity": "", 2021-03-30T05:15:42.398 INFO:tasks.workunit.client.0.smithi197.stdout: "rotational": "1" 2021-03-30T05:15:42.399 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.399 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.399 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap_clean_epochs": { 2021-03-30T05:15:42.399 INFO:tasks.workunit.client.0.smithi197.stdout: "min_last_epoch_clean": 0, 2021-03-30T05:15:42.399 INFO:tasks.workunit.client.0.smithi197.stdout: "last_epoch_clean": { 2021-03-30T05:15:42.400 INFO:tasks.workunit.client.0.smithi197.stdout: "per_pool": [] 2021-03-30T05:15:42.400 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.400 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_epochs": [ 2021-03-30T05:15:42.400 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.400 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:15:42.401 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 5 2021-03-30T05:15:42.401 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.401 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.401 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.401 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap_first_committed": 1, 2021-03-30T05:15:42.402 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap_last_committed": 12, 2021-03-30T05:15:42.402 INFO:tasks.workunit.client.0.smithi197.stdout: "crushmap": { 2021-03-30T05:15:42.402 INFO:tasks.workunit.client.0.smithi197.stdout: "devices": [ 2021-03-30T05:15:42.402 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.403 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:15:42.403 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "osd.0", 2021-03-30T05:15:42.403 INFO:tasks.workunit.client.0.smithi197.stdout: "class": "hdd" 2021-03-30T05:15:42.403 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.403 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.404 INFO:tasks.workunit.client.0.smithi197.stdout: "types": [ 2021-03-30T05:15:42.404 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.404 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 0, 2021-03-30T05:15:42.404 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "osd" 2021-03-30T05:15:42.404 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.405 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.405 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 1, 2021-03-30T05:15:42.405 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "host" 2021-03-30T05:15:42.405 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.406 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.406 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 2, 2021-03-30T05:15:42.406 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "chassis" 2021-03-30T05:15:42.406 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.406 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.407 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 3, 2021-03-30T05:15:42.407 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "rack" 2021-03-30T05:15:42.407 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.407 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.407 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 4, 2021-03-30T05:15:42.408 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "row" 2021-03-30T05:15:42.408 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.408 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.408 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 5, 2021-03-30T05:15:42.408 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "pdu" 2021-03-30T05:15:42.409 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.409 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.409 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 6, 2021-03-30T05:15:42.409 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "pod" 2021-03-30T05:15:42.409 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.410 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.410 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 7, 2021-03-30T05:15:42.410 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "room" 2021-03-30T05:15:42.410 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.411 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.411 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 8, 2021-03-30T05:15:42.411 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "datacenter" 2021-03-30T05:15:42.411 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.411 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.412 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 9, 2021-03-30T05:15:42.412 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "zone" 2021-03-30T05:15:42.412 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.412 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.412 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 10, 2021-03-30T05:15:42.413 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "region" 2021-03-30T05:15:42.413 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.413 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.413 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 11, 2021-03-30T05:15:42.413 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "root" 2021-03-30T05:15:42.414 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.414 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.414 INFO:tasks.workunit.client.0.smithi197.stdout: "buckets": [ 2021-03-30T05:15:42.414 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.414 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -1, 2021-03-30T05:15:42.415 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "default", 2021-03-30T05:15:42.415 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 11, 2021-03-30T05:15:42.415 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "root", 2021-03-30T05:15:42.415 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.415 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:15:42.416 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:15:42.416 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:15:42.416 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.416 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -3, 2021-03-30T05:15:42.417 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.417 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:15:42.417 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.417 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.417 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.418 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.418 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -2, 2021-03-30T05:15:42.418 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "default~hdd", 2021-03-30T05:15:42.418 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 11, 2021-03-30T05:15:42.418 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "root", 2021-03-30T05:15:42.419 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.419 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:15:42.419 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:15:42.419 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:15:42.419 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.420 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -4, 2021-03-30T05:15:42.420 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.420 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:15:42.420 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.420 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.421 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.421 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.421 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -3, 2021-03-30T05:15:42.421 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "smithi197", 2021-03-30T05:15:42.421 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 1, 2021-03-30T05:15:42.422 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "host", 2021-03-30T05:15:42.422 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.422 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:15:42.422 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:15:42.422 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:15:42.423 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.423 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:15:42.423 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.423 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:15:42.424 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.424 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.424 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.424 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.424 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -4, 2021-03-30T05:15:42.425 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "smithi197~hdd", 2021-03-30T05:15:42.425 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 1, 2021-03-30T05:15:42.425 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "host", 2021-03-30T05:15:42.425 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.425 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:15:42.426 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:15:42.426 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:15:42.426 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.426 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:15:42.426 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:15:42.427 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:15:42.427 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.427 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.427 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.428 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.428 INFO:tasks.workunit.client.0.smithi197.stdout: "rules": [ 2021-03-30T05:15:42.428 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.428 INFO:tasks.workunit.client.0.smithi197.stdout: "rule_id": 0, 2021-03-30T05:15:42.428 INFO:tasks.workunit.client.0.smithi197.stdout: "rule_name": "replicated_rule", 2021-03-30T05:15:42.429 INFO:tasks.workunit.client.0.smithi197.stdout: "ruleset": 0, 2021-03-30T05:15:42.429 INFO:tasks.workunit.client.0.smithi197.stdout: "type": 1, 2021-03-30T05:15:42.429 INFO:tasks.workunit.client.0.smithi197.stdout: "min_size": 1, 2021-03-30T05:15:42.429 INFO:tasks.workunit.client.0.smithi197.stdout: "max_size": 10, 2021-03-30T05:15:42.429 INFO:tasks.workunit.client.0.smithi197.stdout: "steps": [ 2021-03-30T05:15:42.430 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.430 INFO:tasks.workunit.client.0.smithi197.stdout: "op": "take", 2021-03-30T05:15:42.430 INFO:tasks.workunit.client.0.smithi197.stdout: "item": -1, 2021-03-30T05:15:42.430 INFO:tasks.workunit.client.0.smithi197.stdout: "item_name": "default" 2021-03-30T05:15:42.430 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.431 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.431 INFO:tasks.workunit.client.0.smithi197.stdout: "op": "choose_firstn", 2021-03-30T05:15:42.431 INFO:tasks.workunit.client.0.smithi197.stdout: "num": 0, 2021-03-30T05:15:42.431 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "osd" 2021-03-30T05:15:42.431 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.432 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.432 INFO:tasks.workunit.client.0.smithi197.stdout: "op": "emit" 2021-03-30T05:15:42.432 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.432 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:15:42.433 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.433 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.433 INFO:tasks.workunit.client.0.smithi197.stdout: "tunables": { 2021-03-30T05:15:42.433 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_local_tries": 0, 2021-03-30T05:15:42.433 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_local_fallback_tries": 0, 2021-03-30T05:15:42.434 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_total_tries": 50, 2021-03-30T05:15:42.434 INFO:tasks.workunit.client.0.smithi197.stdout: "chooseleaf_descend_once": 1, 2021-03-30T05:15:42.434 INFO:tasks.workunit.client.0.smithi197.stdout: "chooseleaf_vary_r": 1, 2021-03-30T05:15:42.434 INFO:tasks.workunit.client.0.smithi197.stdout: "chooseleaf_stable": 1, 2021-03-30T05:15:42.434 INFO:tasks.workunit.client.0.smithi197.stdout: "straw_calc_version": 1, 2021-03-30T05:15:42.435 INFO:tasks.workunit.client.0.smithi197.stdout: "allowed_bucket_algs": 54, 2021-03-30T05:15:42.435 INFO:tasks.workunit.client.0.smithi197.stdout: "profile": "jewel", 2021-03-30T05:15:42.435 INFO:tasks.workunit.client.0.smithi197.stdout: "optimal_tunables": 1, 2021-03-30T05:15:42.435 INFO:tasks.workunit.client.0.smithi197.stdout: "legacy_tunables": 0, 2021-03-30T05:15:42.436 INFO:tasks.workunit.client.0.smithi197.stdout: "minimum_required_version": "jewel", 2021-03-30T05:15:42.436 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables": 1, 2021-03-30T05:15:42.436 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables2": 1, 2021-03-30T05:15:42.436 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v2_rules": 0, 2021-03-30T05:15:42.436 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables3": 1, 2021-03-30T05:15:42.437 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v3_rules": 0, 2021-03-30T05:15:42.437 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v4_buckets": 1, 2021-03-30T05:15:42.437 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables5": 1, 2021-03-30T05:15:42.437 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v5_rules": 0 2021-03-30T05:15:42.437 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.438 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_args": {} 2021-03-30T05:15:42.438 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.438 INFO:tasks.workunit.client.0.smithi197.stdout: "fsmap": { 2021-03-30T05:15:42.438 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 1, 2021-03-30T05:15:42.438 INFO:tasks.workunit.client.0.smithi197.stdout: "default_fscid": -1, 2021-03-30T05:15:42.439 INFO:tasks.workunit.client.0.smithi197.stdout: "compat": { 2021-03-30T05:15:42.439 INFO:tasks.workunit.client.0.smithi197.stdout: "compat": {}, 2021-03-30T05:15:42.439 INFO:tasks.workunit.client.0.smithi197.stdout: "ro_compat": {}, 2021-03-30T05:15:42.439 INFO:tasks.workunit.client.0.smithi197.stdout: "incompat": { 2021-03-30T05:15:42.439 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_1": "base v0.20", 2021-03-30T05:15:42.440 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_2": "client writeable ranges", 2021-03-30T05:15:42.440 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_3": "default file layouts on dirs", 2021-03-30T05:15:42.440 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_4": "dir inode in separate object", 2021-03-30T05:15:42.440 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_5": "mds uses versioned encoding", 2021-03-30T05:15:42.440 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_6": "dirfrag is stored in omap", 2021-03-30T05:15:42.441 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_8": "no anchor table", 2021-03-30T05:15:42.441 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_9": "file layout v2", 2021-03-30T05:15:42.441 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_10": "snaprealm v2" 2021-03-30T05:15:42.441 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.442 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.442 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_flags": { 2021-03-30T05:15:42.442 INFO:tasks.workunit.client.0.smithi197.stdout: "enable_multiple": false, 2021-03-30T05:15:42.442 INFO:tasks.workunit.client.0.smithi197.stdout: "ever_enabled_multiple": false 2021-03-30T05:15:42.442 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.442 INFO:tasks.workunit.client.0.smithi197.stdout: "standbys": [], 2021-03-30T05:15:42.443 INFO:tasks.workunit.client.0.smithi197.stdout: "filesystems": [] 2021-03-30T05:15:42.443 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.443 INFO:tasks.workunit.client.0.smithi197.stdout: "mdsmap_first_committed": 1, 2021-03-30T05:15:42.443 INFO:tasks.workunit.client.0.smithi197.stdout: "mdsmap_last_committed": 1, 2021-03-30T05:15:42.444 INFO:tasks.workunit.client.0.smithi197.stdout: "auth": { 2021-03-30T05:15:42.444 INFO:tasks.workunit.client.0.smithi197.stdout: "first_committed": 1, 2021-03-30T05:15:42.444 INFO:tasks.workunit.client.0.smithi197.stdout: "last_committed": 3, 2021-03-30T05:15:42.444 INFO:tasks.workunit.client.0.smithi197.stdout: "num_secrets": 1 2021-03-30T05:15:42.444 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.445 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg": 4, 2021-03-30T05:15:42.445 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg_active": 4, 2021-03-30T05:15:42.445 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg_unknown": 0, 2021-03-30T05:15:42.445 INFO:tasks.workunit.client.0.smithi197.stdout: "num_osd": 1, 2021-03-30T05:15:42.445 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_sum": { 2021-03-30T05:15:42.446 INFO:tasks.workunit.client.0.smithi197.stdout: "stat_sum": { 2021-03-30T05:15:42.446 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes": 19, 2021-03-30T05:15:42.446 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects": 1, 2021-03-30T05:15:42.446 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_clones": 0, 2021-03-30T05:15:42.446 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_copies": 2, 2021-03-30T05:15:42.447 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing_on_primary": 0, 2021-03-30T05:15:42.447 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing": 0, 2021-03-30T05:15:42.447 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_degraded": 1, 2021-03-30T05:15:42.447 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_misplaced": 0, 2021-03-30T05:15:42.448 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_unfound": 0, 2021-03-30T05:15:42.448 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_dirty": 1, 2021-03-30T05:15:42.448 INFO:tasks.workunit.client.0.smithi197.stdout: "num_whiteouts": 0, 2021-03-30T05:15:42.448 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read": 0, 2021-03-30T05:15:42.448 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read_kb": 0, 2021-03-30T05:15:42.449 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write": 2, 2021-03-30T05:15:42.449 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write_kb": 2, 2021-03-30T05:15:42.449 INFO:tasks.workunit.client.0.smithi197.stdout: "num_scrub_errors": 0, 2021-03-30T05:15:42.449 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shallow_scrub_errors": 0, 2021-03-30T05:15:42.449 INFO:tasks.workunit.client.0.smithi197.stdout: "num_deep_scrub_errors": 0, 2021-03-30T05:15:42.450 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_recovered": 0, 2021-03-30T05:15:42.450 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_recovered": 0, 2021-03-30T05:15:42.450 INFO:tasks.workunit.client.0.smithi197.stdout: "num_keys_recovered": 0, 2021-03-30T05:15:42.450 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_omap": 0, 2021-03-30T05:15:42.450 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_hit_set_archive": 0, 2021-03-30T05:15:42.451 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_hit_set_archive": 0, 2021-03-30T05:15:42.451 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush": 0, 2021-03-30T05:15:42.451 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_kb": 0, 2021-03-30T05:15:42.451 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict": 0, 2021-03-30T05:15:42.452 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_kb": 0, 2021-03-30T05:15:42.452 INFO:tasks.workunit.client.0.smithi197.stdout: "num_promote": 0, 2021-03-30T05:15:42.452 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_high": 0, 2021-03-30T05:15:42.452 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_low": 0, 2021-03-30T05:15:42.452 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_some": 0, 2021-03-30T05:15:42.453 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_full": 0, 2021-03-30T05:15:42.453 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_pinned": 0, 2021-03-30T05:15:42.453 INFO:tasks.workunit.client.0.smithi197.stdout: "num_legacy_snapsets": 0, 2021-03-30T05:15:42.453 INFO:tasks.workunit.client.0.smithi197.stdout: "num_large_omap_objects": 0, 2021-03-30T05:15:42.453 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_manifest": 0, 2021-03-30T05:15:42.454 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_bytes": 0, 2021-03-30T05:15:42.454 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_keys": 0, 2021-03-30T05:15:42.454 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_repaired": 0 2021-03-30T05:15:42.454 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.454 INFO:tasks.workunit.client.0.smithi197.stdout: "store_stats": { 2021-03-30T05:15:42.455 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 0, 2021-03-30T05:15:42.455 INFO:tasks.workunit.client.0.smithi197.stdout: "available": 0, 2021-03-30T05:15:42.455 INFO:tasks.workunit.client.0.smithi197.stdout: "internally_reserved": 0, 2021-03-30T05:15:42.455 INFO:tasks.workunit.client.0.smithi197.stdout: "allocated": 0, 2021-03-30T05:15:42.455 INFO:tasks.workunit.client.0.smithi197.stdout: "data_stored": 0, 2021-03-30T05:15:42.456 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed": 0, 2021-03-30T05:15:42.456 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_allocated": 0, 2021-03-30T05:15:42.456 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_original": 0, 2021-03-30T05:15:42.456 INFO:tasks.workunit.client.0.smithi197.stdout: "omap_allocated": 0, 2021-03-30T05:15:42.456 INFO:tasks.workunit.client.0.smithi197.stdout: "internal_metadata": 0 2021-03-30T05:15:42.457 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.457 INFO:tasks.workunit.client.0.smithi197.stdout: "log_size": 2, 2021-03-30T05:15:42.457 INFO:tasks.workunit.client.0.smithi197.stdout: "ondisk_log_size": 2, 2021-03-30T05:15:42.457 INFO:tasks.workunit.client.0.smithi197.stdout: "up": 4, 2021-03-30T05:15:42.457 INFO:tasks.workunit.client.0.smithi197.stdout: "acting": 4, 2021-03-30T05:15:42.458 INFO:tasks.workunit.client.0.smithi197.stdout: "num_store_stats": 0 2021-03-30T05:15:42.458 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.458 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_sum": { 2021-03-30T05:15:42.458 INFO:tasks.workunit.client.0.smithi197.stdout: "up_from": 0, 2021-03-30T05:15:42.459 INFO:tasks.workunit.client.0.smithi197.stdout: "seq": 0, 2021-03-30T05:15:42.459 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pgs": 4, 2021-03-30T05:15:42.459 INFO:tasks.workunit.client.0.smithi197.stdout: "num_osds": 1, 2021-03-30T05:15:42.459 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_osds": 1, 2021-03-30T05:15:42.459 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_omap_osds": 1, 2021-03-30T05:15:42.460 INFO:tasks.workunit.client.0.smithi197.stdout: "kb": 104857600, 2021-03-30T05:15:42.460 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used": 1050368, 2021-03-30T05:15:42.460 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_data": 1728, 2021-03-30T05:15:42.460 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_omap": 0, 2021-03-30T05:15:42.460 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_meta": 1048576, 2021-03-30T05:15:42.461 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_avail": 103807232, 2021-03-30T05:15:42.461 INFO:tasks.workunit.client.0.smithi197.stdout: "statfs": { 2021-03-30T05:15:42.461 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 107374182400, 2021-03-30T05:15:42.461 INFO:tasks.workunit.client.0.smithi197.stdout: "available": 106298605568, 2021-03-30T05:15:42.461 INFO:tasks.workunit.client.0.smithi197.stdout: "internally_reserved": 1073741824, 2021-03-30T05:15:42.462 INFO:tasks.workunit.client.0.smithi197.stdout: "allocated": 1769472, 2021-03-30T05:15:42.462 INFO:tasks.workunit.client.0.smithi197.stdout: "data_stored": 22750, 2021-03-30T05:15:42.462 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed": 0, 2021-03-30T05:15:42.462 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_allocated": 0, 2021-03-30T05:15:42.462 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_original": 0, 2021-03-30T05:15:42.463 INFO:tasks.workunit.client.0.smithi197.stdout: "omap_allocated": 0, 2021-03-30T05:15:42.463 INFO:tasks.workunit.client.0.smithi197.stdout: "internal_metadata": 1073741824 2021-03-30T05:15:42.463 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.463 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_peers": [], 2021-03-30T05:15:42.463 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_trim_queue_len": 0, 2021-03-30T05:15:42.464 INFO:tasks.workunit.client.0.smithi197.stdout: "num_snap_trimming": 0, 2021-03-30T05:15:42.464 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shards_repaired": 0, 2021-03-30T05:15:42.464 INFO:tasks.workunit.client.0.smithi197.stdout: "op_queue_age_hist": { 2021-03-30T05:15:42.464 INFO:tasks.workunit.client.0.smithi197.stdout: "histogram": [], 2021-03-30T05:15:42.465 INFO:tasks.workunit.client.0.smithi197.stdout: "upper_bound": 1 2021-03-30T05:15:42.465 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.465 INFO:tasks.workunit.client.0.smithi197.stdout: "perf_stat": { 2021-03-30T05:15:42.465 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ms": 0, 2021-03-30T05:15:42.465 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ms": 0, 2021-03-30T05:15:42.466 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ns": 0, 2021-03-30T05:15:42.466 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ns": 0 2021-03-30T05:15:42.466 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.466 INFO:tasks.workunit.client.0.smithi197.stdout: "alerts": [], 2021-03-30T05:15:42.466 INFO:tasks.workunit.client.0.smithi197.stdout: "network_ping_times": [] 2021-03-30T05:15:42.467 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.467 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_sum_by_class": { 2021-03-30T05:15:42.467 INFO:tasks.workunit.client.0.smithi197.stdout: "hdd": { 2021-03-30T05:15:42.467 INFO:tasks.workunit.client.0.smithi197.stdout: "up_from": 0, 2021-03-30T05:15:42.467 INFO:tasks.workunit.client.0.smithi197.stdout: "seq": 0, 2021-03-30T05:15:42.468 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pgs": 4, 2021-03-30T05:15:42.468 INFO:tasks.workunit.client.0.smithi197.stdout: "num_osds": 1, 2021-03-30T05:15:42.468 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_osds": 1, 2021-03-30T05:15:42.468 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_omap_osds": 1, 2021-03-30T05:15:42.468 INFO:tasks.workunit.client.0.smithi197.stdout: "kb": 104857600, 2021-03-30T05:15:42.469 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used": 1050368, 2021-03-30T05:15:42.469 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_data": 1728, 2021-03-30T05:15:42.469 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_omap": 0, 2021-03-30T05:15:42.469 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_meta": 1048576, 2021-03-30T05:15:42.469 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_avail": 103807232, 2021-03-30T05:15:42.470 INFO:tasks.workunit.client.0.smithi197.stdout: "statfs": { 2021-03-30T05:15:42.470 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 107374182400, 2021-03-30T05:15:42.470 INFO:tasks.workunit.client.0.smithi197.stdout: "available": 106298605568, 2021-03-30T05:15:42.470 INFO:tasks.workunit.client.0.smithi197.stdout: "internally_reserved": 1073741824, 2021-03-30T05:15:42.471 INFO:tasks.workunit.client.0.smithi197.stdout: "allocated": 1769472, 2021-03-30T05:15:42.471 INFO:tasks.workunit.client.0.smithi197.stdout: "data_stored": 22750, 2021-03-30T05:15:42.471 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed": 0, 2021-03-30T05:15:42.471 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_allocated": 0, 2021-03-30T05:15:42.471 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_original": 0, 2021-03-30T05:15:42.472 INFO:tasks.workunit.client.0.smithi197.stdout: "omap_allocated": 0, 2021-03-30T05:15:42.472 INFO:tasks.workunit.client.0.smithi197.stdout: "internal_metadata": 1073741824 2021-03-30T05:15:42.472 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.472 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_peers": [], 2021-03-30T05:15:42.472 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_trim_queue_len": 0, 2021-03-30T05:15:42.473 INFO:tasks.workunit.client.0.smithi197.stdout: "num_snap_trimming": 0, 2021-03-30T05:15:42.473 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shards_repaired": 0, 2021-03-30T05:15:42.473 INFO:tasks.workunit.client.0.smithi197.stdout: "op_queue_age_hist": { 2021-03-30T05:15:42.473 INFO:tasks.workunit.client.0.smithi197.stdout: "histogram": [], 2021-03-30T05:15:42.473 INFO:tasks.workunit.client.0.smithi197.stdout: "upper_bound": 1 2021-03-30T05:15:42.474 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.474 INFO:tasks.workunit.client.0.smithi197.stdout: "perf_stat": { 2021-03-30T05:15:42.474 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ms": 0, 2021-03-30T05:15:42.474 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ms": 0, 2021-03-30T05:15:42.474 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ns": 0, 2021-03-30T05:15:42.475 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ns": 0 2021-03-30T05:15:42.475 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.475 INFO:tasks.workunit.client.0.smithi197.stdout: "alerts": [], 2021-03-30T05:15:42.475 INFO:tasks.workunit.client.0.smithi197.stdout: "network_ping_times": [] 2021-03-30T05:15:42.476 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.476 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.476 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_stats": [ 2021-03-30T05:15:42.476 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.476 INFO:tasks.workunit.client.0.smithi197.stdout: "poolid": 1, 2021-03-30T05:15:42.477 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg": 4, 2021-03-30T05:15:42.477 INFO:tasks.workunit.client.0.smithi197.stdout: "stat_sum": { 2021-03-30T05:15:42.477 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes": 19, 2021-03-30T05:15:42.477 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects": 1, 2021-03-30T05:15:42.477 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_clones": 0, 2021-03-30T05:15:42.478 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_copies": 2, 2021-03-30T05:15:42.478 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing_on_primary": 0, 2021-03-30T05:15:42.478 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing": 0, 2021-03-30T05:15:42.478 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_degraded": 1, 2021-03-30T05:15:42.478 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_misplaced": 0, 2021-03-30T05:15:42.479 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_unfound": 0, 2021-03-30T05:15:42.479 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_dirty": 1, 2021-03-30T05:15:42.479 INFO:tasks.workunit.client.0.smithi197.stdout: "num_whiteouts": 0, 2021-03-30T05:15:42.479 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read": 0, 2021-03-30T05:15:42.479 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read_kb": 0, 2021-03-30T05:15:42.480 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write": 2, 2021-03-30T05:15:42.480 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write_kb": 2, 2021-03-30T05:15:42.480 INFO:tasks.workunit.client.0.smithi197.stdout: "num_scrub_errors": 0, 2021-03-30T05:15:42.480 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shallow_scrub_errors": 0, 2021-03-30T05:15:42.480 INFO:tasks.workunit.client.0.smithi197.stdout: "num_deep_scrub_errors": 0, 2021-03-30T05:15:42.481 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_recovered": 0, 2021-03-30T05:15:42.481 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_recovered": 0, 2021-03-30T05:15:42.481 INFO:tasks.workunit.client.0.smithi197.stdout: "num_keys_recovered": 0, 2021-03-30T05:15:42.481 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_omap": 0, 2021-03-30T05:15:42.482 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_hit_set_archive": 0, 2021-03-30T05:15:42.482 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_hit_set_archive": 0, 2021-03-30T05:15:42.482 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush": 0, 2021-03-30T05:15:42.482 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_kb": 0, 2021-03-30T05:15:42.482 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict": 0, 2021-03-30T05:15:42.483 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_kb": 0, 2021-03-30T05:15:42.483 INFO:tasks.workunit.client.0.smithi197.stdout: "num_promote": 0, 2021-03-30T05:15:42.483 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_high": 0, 2021-03-30T05:15:42.483 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_low": 0, 2021-03-30T05:15:42.483 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_some": 0, 2021-03-30T05:15:42.484 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_full": 0, 2021-03-30T05:15:42.484 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_pinned": 0, 2021-03-30T05:15:42.484 INFO:tasks.workunit.client.0.smithi197.stdout: "num_legacy_snapsets": 0, 2021-03-30T05:15:42.484 INFO:tasks.workunit.client.0.smithi197.stdout: "num_large_omap_objects": 0, 2021-03-30T05:15:42.484 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_manifest": 0, 2021-03-30T05:15:42.485 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_bytes": 0, 2021-03-30T05:15:42.485 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_keys": 0, 2021-03-30T05:15:42.485 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_repaired": 0 2021-03-30T05:15:42.485 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.486 INFO:tasks.workunit.client.0.smithi197.stdout: "store_stats": { 2021-03-30T05:15:42.486 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 0, 2021-03-30T05:15:42.486 INFO:tasks.workunit.client.0.smithi197.stdout: "available": 0, 2021-03-30T05:15:42.486 INFO:tasks.workunit.client.0.smithi197.stdout: "internally_reserved": 0, 2021-03-30T05:15:42.486 INFO:tasks.workunit.client.0.smithi197.stdout: "allocated": 65536, 2021-03-30T05:15:42.487 INFO:tasks.workunit.client.0.smithi197.stdout: "data_stored": 19, 2021-03-30T05:15:42.487 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed": 0, 2021-03-30T05:15:42.487 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_allocated": 0, 2021-03-30T05:15:42.487 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_original": 0, 2021-03-30T05:15:42.487 INFO:tasks.workunit.client.0.smithi197.stdout: "omap_allocated": 0, 2021-03-30T05:15:42.488 INFO:tasks.workunit.client.0.smithi197.stdout: "internal_metadata": 0 2021-03-30T05:15:42.488 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.488 INFO:tasks.workunit.client.0.smithi197.stdout: "log_size": 2, 2021-03-30T05:15:42.488 INFO:tasks.workunit.client.0.smithi197.stdout: "ondisk_log_size": 2, 2021-03-30T05:15:42.488 INFO:tasks.workunit.client.0.smithi197.stdout: "up": 4, 2021-03-30T05:15:42.489 INFO:tasks.workunit.client.0.smithi197.stdout: "acting": 4, 2021-03-30T05:15:42.489 INFO:tasks.workunit.client.0.smithi197.stdout: "num_store_stats": 1 2021-03-30T05:15:42.489 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.489 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.489 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_stats": [ 2021-03-30T05:15:42.490 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.490 INFO:tasks.workunit.client.0.smithi197.stdout: "osd": 0, 2021-03-30T05:15:42.490 INFO:tasks.workunit.client.0.smithi197.stdout: "seq": 21474836482 2021-03-30T05:15:42.490 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.491 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.491 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg_by_state": [ 2021-03-30T05:15:42.491 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.491 INFO:tasks.workunit.client.0.smithi197.stdout: "state": "active+undersized+degraded", 2021-03-30T05:15:42.491 INFO:tasks.workunit.client.0.smithi197.stdout: "num": 1 2021-03-30T05:15:42.492 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.492 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.492 INFO:tasks.workunit.client.0.smithi197.stdout: "state": "active+undersized", 2021-03-30T05:15:42.492 INFO:tasks.workunit.client.0.smithi197.stdout: "num": 3 2021-03-30T05:15:42.493 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.493 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.493 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg_by_osd": [ 2021-03-30T05:15:42.493 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.493 INFO:tasks.workunit.client.0.smithi197.stdout: "osd": 0, 2021-03-30T05:15:42.494 INFO:tasks.workunit.client.0.smithi197.stdout: "num_primary_pg": 4, 2021-03-30T05:15:42.494 INFO:tasks.workunit.client.0.smithi197.stdout: "num_acting_pg": 4, 2021-03-30T05:15:42.494 INFO:tasks.workunit.client.0.smithi197.stdout: "num_up_not_acting_pg": 0 2021-03-30T05:15:42.494 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.494 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.495 INFO:tasks.workunit.client.0.smithi197.stdout: "purged_snaps": [ 2021-03-30T05:15:42.495 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:15:42.495 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": 1, 2021-03-30T05:15:42.495 INFO:tasks.workunit.client.0.smithi197.stdout: "purged_snaps": {} 2021-03-30T05:15:42.496 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.496 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:15:42.496 INFO:tasks.workunit.client.0.smithi197.stdout: "servicemap": { 2021-03-30T05:15:42.496 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 1, 2021-03-30T05:15:42.496 INFO:tasks.workunit.client.0.smithi197.stdout: "modified": "2021-03-30T05:15:22.935805+0000", 2021-03-30T05:15:42.497 INFO:tasks.workunit.client.0.smithi197.stdout: "services": {} 2021-03-30T05:15:42.497 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:15:42.497 INFO:tasks.workunit.client.0.smithi197.stdout: "paxos": { 2021-03-30T05:15:42.497 INFO:tasks.workunit.client.0.smithi197.stdout: "first_committed": 1, 2021-03-30T05:15:42.497 INFO:tasks.workunit.client.0.smithi197.stdout: "last_committed": 83, 2021-03-30T05:15:42.498 INFO:tasks.workunit.client.0.smithi197.stdout: "last_pn": 0, 2021-03-30T05:15:42.498 INFO:tasks.workunit.client.0.smithi197.stdout: "accepted_pn": 0 2021-03-30T05:15:42.498 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:15:42.498 INFO:tasks.workunit.client.0.smithi197.stdout:} 2021-03-30T05:15:42.502 INFO:tasks.workunit.client.0.smithi197.stderr:report 3361140940 2021-03-30T05:15:42.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1604: wait_for_clean: return 1 2021-03-30T05:15:42.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1623: test_wait_for_clean: run_osd td/ceph-helpers 1 2021-03-30T05:15:42.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:15:42.503 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:15:42.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:15:42.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:15:42.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:15:42.504 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:15:42.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:15:42.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:15:42.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:15:42.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:15:42.505 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:15:42.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:15:42.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:15:42.506 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:15:42.506 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:15:42.506 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:42.507 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:42.507 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:42.507 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:42.507 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:42.508 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:42.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:42.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:15:42.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:15:42.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:15:42.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:15:42.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:15:42.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:15:42.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:15:42.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:42.510 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:15:42.510 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:15:42.510 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:15:42.510 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:15:42.511 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=1f49860a-844b-4456-84d3-24a1609ad3bb 2021-03-30T05:15:42.511 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 1f49860a-844b-4456-84d3-24a1609ad3bb' 2021-03-30T05:15:42.511 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 1f49860a-844b-4456-84d3-24a1609ad3bb 2021-03-30T05:15:42.512 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:15:42.512 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQD+s2JgO+3gFBAA/Jpwq20ZPu0+ejDsamwHsw== 2021-03-30T05:15:42.512 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQD+s2JgO+3gFBAA/Jpwq20ZPu0+ejDsamwHsw=="}' 2021-03-30T05:15:42.513 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 1f49860a-844b-4456-84d3-24a1609ad3bb -i td/ceph-helpers/1/new.json 2021-03-30T05:15:42.806 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:15:42.816 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/1/new.json 2021-03-30T05:15:42.817 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQD+s2JgO+3gFBAA/Jpwq20ZPu0+ejDsamwHsw== --osd-uuid 1f49860a-844b-4456-84d3-24a1609ad3bb 2021-03-30T05:15:42.838 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:42.837+0000 7f537875df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:42.857 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:42.855+0000 7f537875df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:42.858 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:42.857+0000 7f537875df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:42.859 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:42.858+0000 7f537875df40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:15:42.859 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:42.858+0000 7f537875df40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:15:42.860 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:42.858+0000 7f537875df40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:15:42.923 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:42.922+0000 7f537875df40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2021-03-30T05:15:43.350 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:43.350+0000 7f537875df40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:15:45.976 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/1/keyring 2021-03-30T05:15:45.977 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:15:45.977 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:15:45.978 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:15:45.978 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:15:46.457 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:15:46.457 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:15:46.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:46.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:15:46.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:15:46.459 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:15:46.477 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:46.476+0000 7ff4bb898f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:46.484 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:46.484+0000 7ff4bb898f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:46.485 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:46.485+0000 7ff4bb898f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:46.809 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:15:46.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:15:46.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:15:46.810 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:15:46.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:15:46.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:46.811 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:15:46.811 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:15:46.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:46.812 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:15:47.005 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:47.005+0000 7ff4bb898f40 -1 Falling back to public interface 2021-03-30T05:15:47.166 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:15:47.858 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:47.858+0000 7ff4bb898f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:15:48.167 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:15:48.168 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:48.168 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:15:48.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:15:48.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:48.169 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:15:48.560 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:15:49.561 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:15:49.562 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:15:49.563 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:15:49.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:15:49.564 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:15:49.567 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:15:49.924 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 16 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/69912,v1:127.0.0.1:6811/69912] [v2:127.0.0.1:6812/69912,v1:127.0.0.1:6813/69912] exists,up 1f49860a-844b-4456-84d3-24a1609ad3bb 2021-03-30T05:15:49.928 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:15:49.928 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:15:49.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:15:49.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1624: test_wait_for_clean: wait_for_clean 2021-03-30T05:15:49.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:15:49.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:15:49.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:15:49.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:15:49.931 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 90 .1 2021-03-30T05:15:49.932 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:15:49.932 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:15:49.932 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:15:49.933 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:15:49.933 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:15:50.013 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:15:50.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:15:50.014 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:15:50.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:15:50.015 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:15:50.391 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids='0 2021-03-30T05:15:50.391 INFO:tasks.workunit.client.0.smithi197.stderr:1' 2021-03-30T05:15:50.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:15:50.392 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:15:50.392 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:15:50.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=21474836486 2021-03-30T05:15:50.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 21474836486 2021-03-30T05:15:50.540 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836486' 2021-03-30T05:15:50.541 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:15:50.541 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2021-03-30T05:15:50.663 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=68719476739 2021-03-30T05:15:50.664 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 68719476739 2021-03-30T05:15:50.664 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-21474836486 1-68719476739' 2021-03-30T05:15:50.664 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:15:50.664 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-21474836486 2021-03-30T05:15:50.665 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:15:50.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:15:50.666 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-21474836486 2021-03-30T05:15:50.666 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:15:50.666 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=21474836486 2021-03-30T05:15:50.667 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2021-03-30T05:15:50.667 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 21474836486 2021-03-30T05:15:50.667 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:15:51.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836484 -lt 21474836486 2021-03-30T05:15:51.015 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2085: flush_pg_stats: sleep 1 2021-03-30T05:15:52.016 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2086: flush_pg_stats: '[' 300 -eq 0 ']' 2021-03-30T05:15:52.017 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:15:52.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 21474836486 -lt 21474836486 2021-03-30T05:15:52.376 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:15:52.376 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 1-68719476739 2021-03-30T05:15:52.377 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:15:52.377 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=1 2021-03-30T05:15:52.377 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 1-68719476739 2021-03-30T05:15:52.378 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:15:52.378 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=68719476739 2021-03-30T05:15:52.379 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.1 seq 68719476739' 2021-03-30T05:15:52.379 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.1 seq 68719476739 2021-03-30T05:15:52.379 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 1 2021-03-30T05:15:52.729 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 68719476739 -lt 68719476739 2021-03-30T05:15:52.729 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:15:52.730 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:52.730 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:53.194 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:15:53.194 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:53.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:53.194 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:53.195 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:53.195 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:53.195 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:53.195 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:53.537 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=3 2021-03-30T05:15:53.537 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:53.537 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:53.538 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:54.003 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 3 = 4 2021-03-30T05:15:54.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 3 '!=' -1 2021-03-30T05:15:54.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2021-03-30T05:15:54.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=3 2021-03-30T05:15:54.004 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:15:54.005 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2021-03-30T05:15:54.104 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:15:54.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:54.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:54.105 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:54.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:54.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:54.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:54.106 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:54.447 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=3 2021-03-30T05:15:54.448 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:54.448 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:54.448 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:54.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 3 = 4 2021-03-30T05:15:54.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 3 '!=' 3 2021-03-30T05:15:54.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:15:54.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:15:54.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:15:54.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:15:54.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:15:54.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:15:54.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:15:55.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=3 2021-03-30T05:15:55.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test 3 '!=' null 2021-03-30T05:15:55.382 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1601: wait_for_clean: loop=0 2021-03-30T05:15:55.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:15:55.383 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2021-03-30T05:15:55.483 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:15:55.484 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:15:55.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:15:55.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:15:55.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:15:55.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:15:55.485 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:15:55.485 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:15:55.826 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=4 2021-03-30T05:15:55.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:15:55.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:15:55.827 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:15:56.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 4 = 4 2021-03-30T05:15:56.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: break 2021-03-30T05:15:56.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1611: wait_for_clean: return 0 2021-03-30T05:15:56.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1625: test_wait_for_clean: teardown td/ceph-helpers 2021-03-30T05:15:56.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:56.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:56.292 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:56.292 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:56.292 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:56.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:56.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:56.293 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:56.395 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:56.396 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:56.396 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:56.397 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:56.397 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:56.398 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:56.398 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:56.399 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:56.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:56.400 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:56.400 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:56.401 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:56.401 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:56.402 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:56.405 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:56.406 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:56.406 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:56.406 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:56.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:56.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:56.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:15:56.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_wait_for_health_ok td/ceph-helpers 2021-03-30T05:15:56.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1721: test_wait_for_health_ok: local dir=td/ceph-helpers 2021-03-30T05:15:56.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1723: test_wait_for_health_ok: setup td/ceph-helpers 2021-03-30T05:15:56.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:15:56.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:15:56.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:15:56.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:15:56.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:15:56.410 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:15:56.411 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:15:56.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:15:56.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:15:56.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:15:56.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:15:56.413 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:15:56.413 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:15:56.414 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:15:56.414 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:15:56.414 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:15:56.414 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:15:56.414 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:56.415 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:15:56.415 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:15:56.415 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:15:56.415 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:15:56.417 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:15:56.417 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:15:56.417 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:15:56.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:56.418 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:56.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:15:56.418 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:15:56.419 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:15:56.419 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:15:56.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:15:56.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:56.419 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:56.420 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:15:56.421 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:15:56.421 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:15:56.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:15:56.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:15:56.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1724: test_wait_for_health_ok: run_mon td/ceph-helpers a --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2021-03-30T05:15:56.422 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:15:56.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:15:56.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:15:56.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:15:56.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:15:56.423 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2021-03-30T05:15:56.760 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:15:56.761 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:56.761 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:56.761 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:56.762 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:56.762 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:56.762 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:56.762 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_failsafe_full_ratio=.99 --mon_pg_warn_min_per_osd=0 2021-03-30T05:15:57.001 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:15:57.003 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:15:57.003 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:57.004 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:57.004 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:15:57.004 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:15:57.004 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:57.005 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:57.005 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:57.005 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:57.005 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:57.005 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:57.006 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:57.006 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:57.006 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:15:57.091 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:15:57.091 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:15:57.092 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:15:57.092 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:15:57.092 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:15:57.092 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:15:57.093 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:15:57.093 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:15:57.093 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:15:57.093 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:57.093 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:57.094 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:15:57.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:15:57.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:15:57.178 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1725: test_wait_for_health_ok: run_mgr td/ceph-helpers x --mon_pg_warn_min_per_osd=0 2021-03-30T05:15:57.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:15:57.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:15:57.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:15:57.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:15:57.179 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:15:57.180 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:15:58.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:15:58.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:58.065 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:58.065 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:58.066 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:58.066 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:58.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:58.066 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:15:58.067 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mon_pg_warn_min_per_osd=0 2021-03-30T05:15:58.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1727: test_wait_for_health_ok: run_osd td/ceph-helpers 0 2021-03-30T05:15:58.090 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:15:58.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:15:58.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:15:58.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:15:58.091 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:15:58.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:15:58.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:15:58.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:15:58.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:15:58.092 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:15:58.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:15:58.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:15:58.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:15:58.093 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:15:58.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:15:58.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:15:58.094 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:15:58.094 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:15:58.094 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:15:58.095 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:15:58.095 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:58.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:15:58.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:15:58.095 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:15:58.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:15:58.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:15:58.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:15:58.096 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:15:58.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:15:58.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:15:58.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:15:58.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:15:58.097 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:15:58.098 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:15:58.098 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=bcfb183a-fbc7-452e-9667-418888290b32 2021-03-30T05:15:58.098 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 bcfb183a-fbc7-452e-9667-418888290b32 2021-03-30T05:15:58.099 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 bcfb183a-fbc7-452e-9667-418888290b32' 2021-03-30T05:15:58.099 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:15:58.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAOtGJgo547BhAAixrUKR/oyMOmU/1dZr2kfQ== 2021-03-30T05:15:58.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAOtGJgo547BhAAixrUKR/oyMOmU/1dZr2kfQ=="}' 2021-03-30T05:15:58.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new bcfb183a-fbc7-452e-9667-418888290b32 -i td/ceph-helpers/0/new.json 2021-03-30T05:15:58.422 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:15:58.432 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:15:58.433 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAOtGJgo547BhAAixrUKR/oyMOmU/1dZr2kfQ== --osd-uuid bcfb183a-fbc7-452e-9667-418888290b32 2021-03-30T05:15:58.455 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.454+0000 7f682f360f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:58.456 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.456+0000 7f682f360f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:58.458 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.457+0000 7f682f360f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:15:58.458 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.458+0000 7f682f360f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:15:58.459 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.458+0000 7f682f360f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:15:58.459 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.458+0000 7f682f360f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:15:58.542 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.542+0000 7f682f360f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:15:58.928 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:15:58.927+0000 7f682f360f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:16:01.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:16:01.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:16:01.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:16:01.655 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:16:01.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:16:02.124 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:16:02.125 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:16:02.125 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:02.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:16:02.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:16:02.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:16:02.144 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:02.144+0000 7f68e3b12f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:02.146 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:02.146+0000 7f68e3b12f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:02.148 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:02.148+0000 7f68e3b12f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:02.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:16:02.488 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:02.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:16:02.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:02.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:02.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:02.489 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:02.490 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:02.490 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:02.491 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:02.664 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:02.663+0000 7f68e3b12f40 -1 Falling back to public interface 2021-03-30T05:16:02.840 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:03.434 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:03.433+0000 7f68e3b12f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:16:03.841 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:03.842 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:03.842 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:03.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:03.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:03.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:04.202 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/71067,v1:127.0.0.1:6803/71067] [v2:127.0.0.1:6804/71067,v1:127.0.0.1:6805/71067] exists,up bcfb183a-fbc7-452e-9667-418888290b32 2021-03-30T05:16:04.206 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:04.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:04.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:04.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1728: test_wait_for_health_ok: run_osd td/ceph-helpers 1 2021-03-30T05:16:04.207 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:16:04.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:16:04.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:16:04.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:16:04.208 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:16:04.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:04.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:04.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:04.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:04.209 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:16:04.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:16:04.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:04.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:16:04.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:04.210 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:16:04.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:04.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:04.211 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:04.211 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:04.211 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:04.212 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:04.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:04.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:04.212 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:16:04.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:16:04.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:04.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:04.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:04.213 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:04.214 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:04.214 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:16:04.214 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:16:04.214 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:16:04.214 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:16:04.215 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=44dc12e9-35ce-4da5-b53f-d57eb5c22382 2021-03-30T05:16:04.215 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 44dc12e9-35ce-4da5-b53f-d57eb5c22382 2021-03-30T05:16:04.216 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 44dc12e9-35ce-4da5-b53f-d57eb5c22382' 2021-03-30T05:16:04.216 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:16:04.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAUtGJgwsUYDRAApwvN89gdyGir3hgLp+/TUQ== 2021-03-30T05:16:04.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAUtGJgwsUYDRAApwvN89gdyGir3hgLp+/TUQ=="}' 2021-03-30T05:16:04.220 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 44dc12e9-35ce-4da5-b53f-d57eb5c22382 -i td/ceph-helpers/1/new.json 2021-03-30T05:16:04.774 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:04.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/1/new.json 2021-03-30T05:16:04.785 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAUtGJgwsUYDRAApwvN89gdyGir3hgLp+/TUQ== --osd-uuid 44dc12e9-35ce-4da5-b53f-d57eb5c22382 2021-03-30T05:16:04.807 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:04.807+0000 7f77ba166f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:04.809 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:04.809+0000 7f77ba166f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:04.810 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:04.810+0000 7f77ba166f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:04.812 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:04.812+0000 7f77ba166f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:16:04.812 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:04.812+0000 7f77ba166f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:16:04.812 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:04.812+0000 7f77ba166f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:16:04.900 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:04.900+0000 7f77ba166f40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2021-03-30T05:16:05.327 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:05.327+0000 7f77ba166f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:16:08.044 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/1/keyring 2021-03-30T05:16:08.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:16:08.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:16:08.046 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:16:08.046 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:16:08.572 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:16:08.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:16:08.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:08.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:16:08.573 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:16:08.574 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:16:08.592 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:08.592+0000 7f8b839f6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:08.594 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:08.594+0000 7f8b839f6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:08.596 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:08.596+0000 7f8b839f6f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:08.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:16:08.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:08.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:16:08.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:08.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:08.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:08.932 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:08.932 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:08.933 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:08.933 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:16:09.113 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:09.112+0000 7f8b839f6f40 -1 Falling back to public interface 2021-03-30T05:16:09.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:09.875 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:09.875+0000 7f8b839f6f40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:16:10.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:10.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:10.290 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:10.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:10.290 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:10.291 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:16:10.666 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/71422,v1:127.0.0.1:6811/71422] [v2:127.0.0.1:6812/71422,v1:127.0.0.1:6813/71422] exists,up 44dc12e9-35ce-4da5-b53f-d57eb5c22382 2021-03-30T05:16:10.670 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:10.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:10.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:10.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1729: test_wait_for_health_ok: run_osd td/ceph-helpers 2 2021-03-30T05:16:10.671 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:16:10.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:16:10.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=2 2021-03-30T05:16:10.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:16:10.672 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/2 2021-03-30T05:16:10.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:10.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:10.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:10.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:10.673 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2021-03-30T05:16:10.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2021-03-30T05:16:10.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:10.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:16:10.674 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:10.675 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:16:10.675 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:10.675 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:10.675 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:10.676 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:10.676 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:10.676 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:10.676 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:10.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:10.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:16:10.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:16:10.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:10.677 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:10.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:10.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:10.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:10.678 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:16:10.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:16:10.679 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/2 2021-03-30T05:16:10.679 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:16:10.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=49e22acf-4213-486d-af51-1dd33b2db409 2021-03-30T05:16:10.680 INFO:tasks.workunit.client.0.smithi197.stdout:add osd2 49e22acf-4213-486d-af51-1dd33b2db409 2021-03-30T05:16:10.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd2 49e22acf-4213-486d-af51-1dd33b2db409' 2021-03-30T05:16:10.681 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:16:10.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAatGJgUG2/KBAAsvbIx5FtcsciYcbSmwogtw== 2021-03-30T05:16:10.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAatGJgUG2/KBAAsvbIx5FtcsciYcbSmwogtw=="}' 2021-03-30T05:16:10.684 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 49e22acf-4213-486d-af51-1dd33b2db409 -i td/ceph-helpers/2/new.json 2021-03-30T05:16:11.227 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:16:11.237 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/2/new.json 2021-03-30T05:16:11.238 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 2 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAatGJgUG2/KBAAsvbIx5FtcsciYcbSmwogtw== --osd-uuid 49e22acf-4213-486d-af51-1dd33b2db409 2021-03-30T05:16:11.260 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.259+0000 7fca89a4df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:11.262 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.260+0000 7fca89a4df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:11.262 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.261+0000 7fca89a4df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:11.263 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.262+0000 7fca89a4df40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:16:11.263 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.262+0000 7fca89a4df40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:16:11.264 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.262+0000 7fca89a4df40 -1 bluestore(td/ceph-helpers/2/block) _read_bdev_label failed to open td/ceph-helpers/2/block: (2) No such file or directory 2021-03-30T05:16:11.300 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.299+0000 7fca89a4df40 -1 bluestore(td/ceph-helpers/2) _read_fsid unparsable uuid 2021-03-30T05:16:11.813 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:11.813+0000 7fca89a4df40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:16:14.793 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/2/keyring 2021-03-30T05:16:14.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:16:14.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd2 key to auth repository 2021-03-30T05:16:14.795 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd2 key to auth repository 2021-03-30T05:16:14.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:16:15.267 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.2 2021-03-30T05:16:15.268 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:16:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 2 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:16:15.269 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:16:15.270 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:16:15.287 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:15.286+0000 7f150cf24f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:15.289 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:15.288+0000 7f150cf24f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:15.291 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:15.289+0000 7f150cf24f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:15.620 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 2 2021-03-30T05:16:15.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:15.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:16:15.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:15.621 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:15.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:15.622 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:15.622 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:15.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:15.623 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:16:15.807 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:15.805+0000 7f150cf24f40 -1 Falling back to public interface 2021-03-30T05:16:15.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:16.542 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:16.541+0000 7f150cf24f40 -1 osd.2 0 log_to_monitors {default=true} 2021-03-30T05:16:16.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:16.974 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:16.974 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:16.975 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:16.975 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:16.975 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:16:17.342 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/71777,v1:127.0.0.1:6819/71777] [v2:127.0.0.1:6820/71777,v1:127.0.0.1:6821/71777] exists,up 49e22acf-4213-486d-af51-1dd33b2db409 2021-03-30T05:16:17.343 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:17.343 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:17.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:17.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1730: test_wait_for_health_ok: kill_daemons td/ceph-helpers TERM osd 2021-03-30T05:16:17.344 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:16:17.344 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:16:17.344 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:16:17.345 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:16:17.345 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:16:17.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:16:17.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1731: test_wait_for_health_ok: ceph osd down 0 2021-03-30T05:16:17.982 INFO:tasks.workunit.client.0.smithi197.stderr:osd.0 is already down. 2021-03-30T05:16:17.991 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1733: test_wait_for_health_ok: TIMEOUT=1 2021-03-30T05:16:17.991 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1733: test_wait_for_health_ok: wait_for_health_ok 2021-03-30T05:16:17.991 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_health_ok: wait_for_health HEALTH_OK 2021-03-30T05:16:17.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1696: wait_for_health: local grepstr=HEALTH_OK 2021-03-30T05:16:17.992 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1697: wait_for_health: delays=($(get_timeout_delays $TIMEOUT .1)) 2021-03-30T05:16:17.992 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1697: wait_for_health: get_timeout_delays 1 .1 2021-03-30T05:16:17.993 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:16:17.993 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:16:17.993 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:16:17.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:16:17.994 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:16:18.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1697: wait_for_health: local -a delays 2021-03-30T05:16:18.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1698: wait_for_health: local -i loop=0 2021-03-30T05:16:18.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: ceph health detail 2021-03-30T05:16:18.018 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: grep HEALTH_OK 2021-03-30T05:16:18.486 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1701: wait_for_health: (( 0 >= 4 )) 2021-03-30T05:16:18.487 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1705: wait_for_health: sleep 0.1 2021-03-30T05:16:18.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_health: loop+=1 2021-03-30T05:16:18.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: ceph health detail 2021-03-30T05:16:18.588 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: grep HEALTH_OK 2021-03-30T05:16:19.052 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1701: wait_for_health: (( 1 >= 4 )) 2021-03-30T05:16:19.053 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1705: wait_for_health: sleep 0.2 2021-03-30T05:16:19.253 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_health: loop+=1 2021-03-30T05:16:19.254 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: ceph health detail 2021-03-30T05:16:19.254 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: grep HEALTH_OK 2021-03-30T05:16:19.719 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1701: wait_for_health: (( 2 >= 4 )) 2021-03-30T05:16:19.720 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1705: wait_for_health: sleep 0.4 2021-03-30T05:16:20.120 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_health: loop+=1 2021-03-30T05:16:20.120 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: ceph health detail 2021-03-30T05:16:20.121 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: grep HEALTH_OK 2021-03-30T05:16:20.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1701: wait_for_health: (( 3 >= 4 )) 2021-03-30T05:16:20.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1705: wait_for_health: sleep 0.3 2021-03-30T05:16:20.890 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_health: loop+=1 2021-03-30T05:16:20.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: ceph health detail 2021-03-30T05:16:20.891 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: grep HEALTH_OK 2021-03-30T05:16:21.353 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1701: wait_for_health: (( 4 >= 4 )) 2021-03-30T05:16:21.354 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_health: ceph health detail 2021-03-30T05:16:21.829 INFO:tasks.workunit.client.0.smithi197.stdout:HEALTH_WARN 1 osds down 2021-03-30T05:16:21.830 INFO:tasks.workunit.client.0.smithi197.stdout:[WRN] OSD_DOWN: 1 osds down 2021-03-30T05:16:21.830 INFO:tasks.workunit.client.0.smithi197.stdout: osd.0 (root=default,host=smithi197) is down 2021-03-30T05:16:21.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_health: return 1 2021-03-30T05:16:21.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_health_ok: return 1 2021-03-30T05:16:21.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1735: test_wait_for_health_ok: activate_osd td/ceph-helpers 0 2021-03-30T05:16:21.843 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ceph-helpers 2021-03-30T05:16:21.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2021-03-30T05:16:21.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=0 2021-03-30T05:16:21.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2021-03-30T05:16:21.844 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:16:21.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:21.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:21.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:21.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:21.845 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:16:21.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:16:21.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:21.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2021-03-30T05:16:21.846 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:21.846 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2021-03-30T05:16:21.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:21.847 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:21.847 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:21.847 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:21.847 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:21.848 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:21.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:21.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:21.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:21.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:21.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:21.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:21.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:21.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2021-03-30T05:16:21.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2021-03-30T05:16:21.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:16:21.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.0 2021-03-30T05:16:21.850 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:16:21.851 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:21.852 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ceph-helpers/0/whoami 2021-03-30T05:16:21.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 0 = 0 ']' 2021-03-30T05:16:21.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2021-03-30T05:16:21.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2021-03-30T05:16:21.852 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2021-03-30T05:16:21.861 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:21.860+0000 7f001a9bef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:21.863 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:21.862+0000 7f001a9bef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:21.865 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:21.864+0000 7f001a9bef40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:22.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 0 2021-03-30T05:16:22.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:22.198 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:16:22.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:22.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:22.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:22.200 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:22.200 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:22.200 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:22.201 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:22.380 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:22.379+0000 7f001a9bef40 -1 Falling back to public interface 2021-03-30T05:16:22.549 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:23.263 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:23.262+0000 7f001a9bef40 -1 osd.0 13 log_to_monitors {default=true} 2021-03-30T05:16:23.550 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:23.551 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:23.551 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:23.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:23.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:23.552 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:23.959 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 17 up_thru 0 down_at 16 last_clean_interval [5,13) [v2:127.0.0.1:6802/72221,v1:127.0.0.1:6803/72221] [v2:127.0.0.1:6804/72221,v1:127.0.0.1:6805/72221] exists,up bcfb183a-fbc7-452e-9667-418888290b32 2021-03-30T05:16:23.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:23.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:23.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:23.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1736: test_wait_for_health_ok: activate_osd td/ceph-helpers 1 2021-03-30T05:16:23.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ceph-helpers 2021-03-30T05:16:23.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2021-03-30T05:16:23.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=1 2021-03-30T05:16:23.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2021-03-30T05:16:23.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:16:23.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:23.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:23.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:23.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:23.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:16:23.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:16:23.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:23.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2021-03-30T05:16:23.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:23.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2021-03-30T05:16:23.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:23.967 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:23.968 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:23.968 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:23.968 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:23.968 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:23.968 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:23.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:23.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:23.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:23.969 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:23.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:23.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:23.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2021-03-30T05:16:23.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2021-03-30T05:16:23.970 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:16:23.971 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:16:23.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.1 2021-03-30T05:16:23.972 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:23.972 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ceph-helpers/1/whoami 2021-03-30T05:16:23.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 1 = 1 ']' 2021-03-30T05:16:23.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2021-03-30T05:16:23.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2021-03-30T05:16:23.973 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2021-03-30T05:16:23.981 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:23.980+0000 7f2ed663df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:23.983 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:23.982+0000 7f2ed663df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:23.985 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:23.983+0000 7f2ed663df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:24.336 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 1 2021-03-30T05:16:24.336 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:24.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:16:24.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:24.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:24.337 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:24.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:24.338 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:24.338 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:24.339 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:16:24.500 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:24.499+0000 7f2ed663df40 -1 Falling back to public interface 2021-03-30T05:16:24.688 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:25.366 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:25.365+0000 7f2ed663df40 -1 osd.1 14 log_to_monitors {default=true} 2021-03-30T05:16:25.689 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:25.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:25.690 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:25.690 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:25.691 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:25.691 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:16:26.051 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 19 up_thru 0 down_at 18 last_clean_interval [10,14) [v2:127.0.0.1:6810/72415,v1:127.0.0.1:6811/72415] [v2:127.0.0.1:6812/72415,v1:127.0.0.1:6813/72415] exists,up 44dc12e9-35ce-4da5-b53f-d57eb5c22382 2021-03-30T05:16:26.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:26.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:26.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:26.055 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1737: test_wait_for_health_ok: activate_osd td/ceph-helpers 2 2021-03-30T05:16:26.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: local dir=td/ceph-helpers 2021-03-30T05:16:26.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: shift 2021-03-30T05:16:26.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local id=2 2021-03-30T05:16:26.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2021-03-30T05:16:26.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local osd_data=td/ceph-helpers/2 2021-03-30T05:16:26.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:26.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:26.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:26.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:26.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-data=td/ceph-helpers/2' 2021-03-30T05:16:26.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-journal=td/ceph-helpers/2/journal' 2021-03-30T05:16:26.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:26.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+= 2021-03-30T05:16:26.059 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:26.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: get_asok_path 2021-03-30T05:16:26.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:26.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:26.059 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:26.060 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:26.060 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:26.060 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:26.060 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:26.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:26.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:26.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:26.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:26.061 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:26.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:26.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' ' 2021-03-30T05:16:26.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+= 2021-03-30T05:16:26.062 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: mkdir -p td/ceph-helpers/2 2021-03-30T05:16:26.063 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.2 2021-03-30T05:16:26.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: echo start osd.2 2021-03-30T05:16:26.064 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: ceph-osd -i 2 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/2 --osd-journal=td/ceph-helpers/2/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:26.064 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: cat td/ceph-helpers/2/whoami 2021-03-30T05:16:26.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: '[' 2 = 2 ']' 2021-03-30T05:16:26.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: ceph osd dump --format=json 2021-03-30T05:16:26.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: jq '.flags_set[]' 2021-03-30T05:16:26.065 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: grep -q '"noup"' 2021-03-30T05:16:26.073 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:26.072+0000 7f8fb0343f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:26.074 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:26.074+0000 7f8fb0343f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:26.076 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:26.076+0000 7f8fb0343f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:26.407 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: wait_for_osd up 2 2021-03-30T05:16:26.407 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:26.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=2 2021-03-30T05:16:26.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:26.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:26.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:26.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:26.410 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:26.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:26.411 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:16:26.601 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:26.601+0000 7f8fb0343f40 -1 Falling back to public interface 2021-03-30T05:16:26.757 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:27.713 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:27.713+0000 7f8fb0343f40 -1 osd.2 14 log_to_monitors {default=true} 2021-03-30T05:16:27.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:27.758 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:27.759 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:27.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:27.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:27.760 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.2 up' 2021-03-30T05:16:28.124 INFO:tasks.workunit.client.0.smithi197.stdout:osd.2 up in weight 1 up_from 20 up_thru 0 down_at 18 last_clean_interval [0,0) [v2:127.0.0.1:6818/72609,v1:127.0.0.1:6819/72609] [v2:127.0.0.1:6820/72609,v1:127.0.0.1:6821/72609] exists,up 49e22acf-4213-486d-af51-1dd33b2db409 2021-03-30T05:16:28.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:28.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:28.126 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:28.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1738: test_wait_for_health_ok: wait_for_health_ok 2021-03-30T05:16:28.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1717: wait_for_health_ok: wait_for_health HEALTH_OK 2021-03-30T05:16:28.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1696: wait_for_health: local grepstr=HEALTH_OK 2021-03-30T05:16:28.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1697: wait_for_health: delays=($(get_timeout_delays $TIMEOUT .1)) 2021-03-30T05:16:28.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1697: wait_for_health: get_timeout_delays 300 .1 2021-03-30T05:16:28.128 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:16:28.128 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:16:28.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:16:28.128 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:16:28.129 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:16:28.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1697: wait_for_health: local -a delays 2021-03-30T05:16:28.307 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1698: wait_for_health: local -i loop=0 2021-03-30T05:16:28.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: ceph health detail 2021-03-30T05:16:28.308 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1700: wait_for_health: grep HEALTH_OK 2021-03-30T05:16:28.774 INFO:tasks.workunit.client.0.smithi197.stdout:HEALTH_OK 2021-03-30T05:16:28.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1739: test_wait_for_health_ok: teardown td/ceph-helpers 2021-03-30T05:16:28.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:16:28.776 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:16:28.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:16:28.777 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:16:28.777 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:16:28.777 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:16:28.778 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:16:28.778 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:16:28.883 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:16:28.884 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:16:28.884 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:16:28.885 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:16:28.886 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:16:28.886 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:16:28.886 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:16:28.887 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:28.888 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:16:28.888 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:16:28.888 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:28.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:16:28.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:16:28.889 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:16:28.893 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:16:28.893 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:28.894 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:28.894 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:16:28.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:16:28.896 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:16:28.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:16:28.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_wait_for_osd td/ceph-helpers 2021-03-30T05:16:28.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:933: test_wait_for_osd: local dir=td/ceph-helpers 2021-03-30T05:16:28.897 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:934: test_wait_for_osd: setup td/ceph-helpers 2021-03-30T05:16:28.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:16:28.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:16:28.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:16:28.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:16:28.898 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:16:28.899 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:16:28.899 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:16:28.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:16:28.899 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:16:28.900 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:16:28.900 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:16:28.900 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:16:28.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:16:28.902 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:16:28.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:16:28.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:16:28.903 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:16:28.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:28.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:16:28.903 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:16:28.904 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:28.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:16:28.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:16:28.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:16:28.907 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:16:28.907 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:28.907 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:28.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:16:28.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:16:28.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:16:28.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:16:28.908 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:16:28.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:28.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:28.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:16:28.909 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:16:28.909 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:16:28.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:16:28.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:16:28.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:935: test_wait_for_osd: run_mon td/ceph-helpers a --osd_pool_default_size=1 2021-03-30T05:16:28.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:16:28.910 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:16:28.911 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:16:28.911 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:16:28.911 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:16:28.911 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=1 2021-03-30T05:16:29.213 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:16:29.213 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:29.213 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:29.214 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:29.214 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:29.214 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:29.214 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:29.215 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2021-03-30T05:16:29.380 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:16:29.382 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:16:29.382 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:16:29.382 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:16:29.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:16:29.383 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:16:29.383 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:16:29.383 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:16:29.384 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:16:29.384 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:16:29.384 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:29.384 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:29.384 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:16:29.385 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:16:29.385 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:16:29.470 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:16:29.470 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:16:29.470 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:16:29.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:16:29.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:16:29.471 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:16:29.471 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:16:29.472 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:16:29.472 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:16:29.472 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:29.472 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:29.472 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:16:29.473 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:16:29.473 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:16:29.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:936: test_wait_for_osd: run_mgr td/ceph-helpers x 2021-03-30T05:16:29.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:16:29.556 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:16:29.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:16:29.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:16:29.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:16:29.557 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:16:30.427 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:16:30.428 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:30.428 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:30.428 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:30.429 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:30.429 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:30.429 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:30.430 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:16:30.430 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:16:30.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:937: test_wait_for_osd: run_osd td/ceph-helpers 0 2021-03-30T05:16:30.452 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:16:30.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:16:30.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:16:30.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:16:30.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:16:30.453 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:30.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:30.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:30.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:30.454 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:16:30.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:16:30.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:30.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:16:30.455 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:30.455 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:16:30.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:30.456 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:30.456 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:30.456 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:30.457 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:30.457 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:30.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:30.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:30.458 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:16:30.459 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:16:30.459 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:30.460 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:30.460 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:30.460 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:30.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:30.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:16:30.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:16:30.462 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:16:30.462 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:16:30.463 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=96a8c0e5-25f2-48ff-865b-a6d6c6f85306 2021-03-30T05:16:30.464 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 96a8c0e5-25f2-48ff-865b-a6d6c6f85306 2021-03-30T05:16:30.465 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 96a8c0e5-25f2-48ff-865b-a6d6c6f85306' 2021-03-30T05:16:30.471 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:16:30.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQAutGJgtSzNGxAAT4ElK3GcvK3ClzBAtKHSug== 2021-03-30T05:16:30.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQAutGJgtSzNGxAAT4ElK3GcvK3ClzBAtKHSug=="}' 2021-03-30T05:16:30.472 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new 96a8c0e5-25f2-48ff-865b-a6d6c6f85306 -i td/ceph-helpers/0/new.json 2021-03-30T05:16:30.810 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:30.820 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:16:30.821 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAutGJgtSzNGxAAT4ElK3GcvK3ClzBAtKHSug== --osd-uuid 96a8c0e5-25f2-48ff-865b-a6d6c6f85306 2021-03-30T05:16:30.843 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:30.843+0000 7f455d769f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:30.845 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:30.844+0000 7f455d769f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:30.847 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:30.847+0000 7f455d769f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:30.848 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:30.847+0000 7f455d769f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:16:30.848 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:30.847+0000 7f455d769f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:16:30.848 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:30.847+0000 7f455d769f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:16:30.879 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:30.879+0000 7f455d769f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:16:31.298 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:31.297+0000 7f455d769f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:16:34.056 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:16:34.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:16:34.057 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:16:34.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:16:34.058 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:16:34.526 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:16:34.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:16:34.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:34.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:16:34.527 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:16:34.528 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:16:34.546 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:34.545+0000 7f60c5c03f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:34.547 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:34.547+0000 7f60c5c03f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:34.549 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:34.549+0000 7f60c5c03f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:34.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:16:34.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:34.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:16:34.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:34.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:34.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:34.924 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:34.925 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:34.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:34.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:35.068 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:35.067+0000 7f60c5c03f40 -1 Falling back to public interface 2021-03-30T05:16:35.273 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:35.770 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:35.770+0000 7f60c5c03f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:16:36.275 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:36.275 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:36.276 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:36.277 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:36.277 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:36.278 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:36.641 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/73485,v1:127.0.0.1:6803/73485] [v2:127.0.0.1:6804/73485,v1:127.0.0.1:6805/73485] exists,up 96a8c0e5-25f2-48ff-865b-a6d6c6f85306 2021-03-30T05:16:36.646 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:36.646 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:36.646 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:36.646 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:938: test_wait_for_osd: run_osd td/ceph-helpers 1 2021-03-30T05:16:36.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:16:36.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:16:36.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=1 2021-03-30T05:16:36.647 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:16:36.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/1 2021-03-30T05:16:36.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:36.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:36.648 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:36.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:36.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/1' 2021-03-30T05:16:36.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/1/journal' 2021-03-30T05:16:36.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:36.649 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:16:36.650 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:36.650 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:16:36.650 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:36.650 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:36.650 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:36.651 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:36.651 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:36.651 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:36.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:36.651 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:36.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:16:36.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:16:36.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:36.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:36.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:36.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:36.653 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:36.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:16:36.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:16:36.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/1 2021-03-30T05:16:36.654 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:16:36.654 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=d13af036-8536-4762-ae03-059698b032f8 2021-03-30T05:16:36.655 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd1 d13af036-8536-4762-ae03-059698b032f8' 2021-03-30T05:16:36.655 INFO:tasks.workunit.client.0.smithi197.stdout:add osd1 d13af036-8536-4762-ae03-059698b032f8 2021-03-30T05:16:36.656 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:16:36.659 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQA0tGJgvo9LJxAA/50DjM22YcrnjclMwAR1nQ== 2021-03-30T05:16:36.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQA0tGJgvo9LJxAA/50DjM22YcrnjclMwAR1nQ=="}' 2021-03-30T05:16:36.660 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new d13af036-8536-4762-ae03-059698b032f8 -i td/ceph-helpers/1/new.json 2021-03-30T05:16:37.128 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:37.139 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/1/new.json 2021-03-30T05:16:37.140 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA0tGJgvo9LJxAA/50DjM22YcrnjclMwAR1nQ== --osd-uuid d13af036-8536-4762-ae03-059698b032f8 2021-03-30T05:16:37.161 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.161+0000 7f3ddd357f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:37.163 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.163+0000 7f3ddd357f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:37.165 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.165+0000 7f3ddd357f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:37.166 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.165+0000 7f3ddd357f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:16:37.166 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.165+0000 7f3ddd357f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:16:37.166 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.165+0000 7f3ddd357f40 -1 bluestore(td/ceph-helpers/1/block) _read_bdev_label failed to open td/ceph-helpers/1/block: (2) No such file or directory 2021-03-30T05:16:37.203 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.203+0000 7f3ddd357f40 -1 bluestore(td/ceph-helpers/1) _read_fsid unparsable uuid 2021-03-30T05:16:37.756 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:37.755+0000 7f3ddd357f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:16:40.626 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/1/keyring 2021-03-30T05:16:40.626 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:16:40.627 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd1 key to auth repository 2021-03-30T05:16:40.628 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd1 key to auth repository 2021-03-30T05:16:40.628 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:16:41.105 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.1 2021-03-30T05:16:41.106 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.1 2021-03-30T05:16:41.106 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 1 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/1 --osd-journal=td/ceph-helpers/1/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:41.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:16:41.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:16:41.107 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:16:41.125 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:41.125+0000 7fbef5a3df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:41.127 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:41.127+0000 7fbef5a3df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:41.129 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:41.128+0000 7fbef5a3df40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:41.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 1 2021-03-30T05:16:41.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:41.492 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:16:41.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:41.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:41.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:41.493 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:41.494 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:41.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:41.494 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:16:41.645 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:41.644+0000 7fbef5a3df40 -1 Falling back to public interface 2021-03-30T05:16:41.847 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:42.413 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:42.412+0000 7fbef5a3df40 -1 osd.1 0 log_to_monitors {default=true} 2021-03-30T05:16:42.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:42.848 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:42.849 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:42.849 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:42.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:42.850 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:16:43.221 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/73840,v1:127.0.0.1:6811/73840] [v2:127.0.0.1:6812/73840,v1:127.0.0.1:6813/73840] exists,up d13af036-8536-4762-ae03-059698b032f8 2021-03-30T05:16:43.222 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:43.222 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:43.222 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:43.223 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:939: test_wait_for_osd: wait_for_osd up 0 2021-03-30T05:16:43.223 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:43.223 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:16:43.223 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:43.224 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:43.224 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:43.224 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:43.224 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:43.225 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:43.225 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:43.588 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/73485,v1:127.0.0.1:6803/73485] [v2:127.0.0.1:6804/73485,v1:127.0.0.1:6805/73485] exists,up 96a8c0e5-25f2-48ff-865b-a6d6c6f85306 2021-03-30T05:16:43.589 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:43.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:43.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:43.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:940: test_wait_for_osd: wait_for_osd up 1 2021-03-30T05:16:43.590 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:43.591 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=1 2021-03-30T05:16:43.591 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:43.591 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:43.591 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:43.591 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:43.592 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:43.592 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:43.593 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.1 up' 2021-03-30T05:16:43.961 INFO:tasks.workunit.client.0.smithi197.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/73840,v1:127.0.0.1:6811/73840] [v2:127.0.0.1:6812/73840,v1:127.0.0.1:6813/73840] exists,up d13af036-8536-4762-ae03-059698b032f8 2021-03-30T05:16:43.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:43.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:43.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:43.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:941: test_wait_for_osd: kill_daemons td/ceph-helpers TERM osd.0 2021-03-30T05:16:43.965 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:16:43.966 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:16:43.966 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:16:43.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:16:43.967 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:16:44.067 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:16:44.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:942: test_wait_for_osd: wait_for_osd down 0 2021-03-30T05:16:44.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=down 2021-03-30T05:16:44.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:16:44.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:44.068 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:44.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:44.069 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:44.069 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:44.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:44.070 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 down' 2021-03-30T05:16:44.437 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 down in weight 1 up_from 5 up_thru 0 down_at 12 last_clean_interval [0,0) [v2:127.0.0.1:6802/73485,v1:127.0.0.1:6803/73485] [v2:127.0.0.1:6804/73485,v1:127.0.0.1:6805/73485] exists 96a8c0e5-25f2-48ff-865b-a6d6c6f85306 2021-03-30T05:16:44.438 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:44.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:44.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:44.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:943: test_wait_for_osd: TIMEOUT=1 2021-03-30T05:16:44.439 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:943: test_wait_for_osd: wait_for_osd up 0 2021-03-30T05:16:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:16:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:44.440 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 1 )) 2021-03-30T05:16:44.441 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:44.441 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:44.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:44.442 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:44.792 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:45.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:45.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 1 )) 2021-03-30T05:16:45.794 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 1 2021-03-30T05:16:45.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:944: test_wait_for_osd: teardown td/ceph-helpers 2021-03-30T05:16:45.795 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:16:45.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:16:45.796 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:16:45.796 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:16:45.797 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:16:45.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:16:45.797 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:16:45.798 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:16:45.901 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:16:45.902 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:16:45.902 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:16:45.903 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:16:45.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:16:45.904 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:16:45.904 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:16:45.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:45.906 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:16:45.907 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:16:45.907 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:45.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:16:45.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:16:45.908 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:16:45.912 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:16:45.912 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:45.912 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:45.912 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:16:45.914 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:16:45.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:16:45.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2176: run_tests: for func in $funcs 2021-03-30T05:16:45.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2177: run_tests: test_wait_for_peered td/ceph-helpers 2021-03-30T05:16:45.915 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: test_wait_for_peered: local dir=td/ceph-helpers 2021-03-30T05:16:45.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: test_wait_for_peered: setup td/ceph-helpers 2021-03-30T05:16:45.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ceph-helpers 2021-03-30T05:16:45.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ceph-helpers 2021-03-30T05:16:45.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ceph-helpers 2021-03-30T05:16:45.916 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2021-03-30T05:16:45.917 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ceph-helpers KILL 2021-03-30T05:16:45.917 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2021-03-30T05:16:45.917 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2021-03-30T05:16:45.917 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2021-03-30T05:16:45.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2021-03-30T05:16:45.918 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2021-03-30T05:16:45.919 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2021-03-30T05:16:45.919 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2021-03-30T05:16:45.919 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2021-03-30T05:16:45.920 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2021-03-30T05:16:45.920 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2021-03-30T05:16:45.920 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2021-03-30T05:16:45.920 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2021-03-30T05:16:45.921 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:45.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2021-03-30T05:16:45.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2021-03-30T05:16:45.922 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-30T05:16:45.922 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2021-03-30T05:16:45.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2021-03-30T05:16:45.923 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ceph-helpers 2021-03-30T05:16:45.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2021-03-30T05:16:45.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:45.924 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:45.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.43807 2021-03-30T05:16:45.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2021-03-30T05:16:45.925 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2021-03-30T05:16:45.926 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ceph-helpers 2021-03-30T05:16:45.927 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2021-03-30T05:16:45.927 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:45.927 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:45.927 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.43807 2021-03-30T05:16:45.929 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2021-03-30T05:16:45.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2021-03-30T05:16:45.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2021-03-30T05:16:45.929 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ceph-helpers 1' TERM HUP INT 2021-03-30T05:16:45.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: test_wait_for_peered: run_mon td/ceph-helpers a --osd_pool_default_size=2 2021-03-30T05:16:45.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ceph-helpers 2021-03-30T05:16:45.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2021-03-30T05:16:45.930 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2021-03-30T05:16:45.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2021-03-30T05:16:45.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ceph-helpers/a 2021-03-30T05:16:45.931 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ceph-helpers/a --run-dir=td/ceph-helpers --osd_pool_default_size=2 2021-03-30T05:16:46.254 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2021-03-30T05:16:46.255 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:46.255 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:46.255 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:46.255 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:46.255 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:46.256 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:46.256 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ceph-helpers/a '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --mon-cluster-log-file=td/ceph-helpers/log --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mon-allow-pool-delete --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2021-03-30T05:16:46.448 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: cat 2021-03-30T05:16:46.449 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a fsid 2021-03-30T05:16:46.450 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:16:46.450 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:16:46.450 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=fsid 2021-03-30T05:16:46.450 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .fsid 2021-03-30T05:16:46.452 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:16:46.452 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:16:46.452 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:16:46.452 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:16:46.453 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:46.453 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:46.453 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:16:46.453 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:16:46.454 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get fsid 2021-03-30T05:16:46.547 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:486: run_mon: get_config mon a mon_host 2021-03-30T05:16:46.547 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1063: get_config: local daemon=mon 2021-03-30T05:16:46.547 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1064: get_config: local id=a 2021-03-30T05:16:46.548 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1065: get_config: local config=mon_host 2021-03-30T05:16:46.548 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1070: get_config: jq -r .mon_host 2021-03-30T05:16:46.548 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: get_asok_path mon.a 2021-03-30T05:16:46.548 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2021-03-30T05:16:46.549 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2021-03-30T05:16:46.549 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2021-03-30T05:16:46.549 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:46.549 INFO:tasks.workunit.client.0.smithi197.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:46.549 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.43807/ceph-mon.a.asok 2021-03-30T05:16:46.550 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: CEPH_ARGS= 2021-03-30T05:16:46.550 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1067: get_config: ceph --format json daemon /tmp/ceph-asok.43807/ceph-mon.a.asok config get mon_host 2021-03-30T05:16:46.638 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: test_wait_for_peered: run_osd td/ceph-helpers 0 2021-03-30T05:16:46.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: local dir=td/ceph-helpers 2021-03-30T05:16:46.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: shift 2021-03-30T05:16:46.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: local id=0 2021-03-30T05:16:46.639 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: shift 2021-03-30T05:16:46.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: local osd_data=td/ceph-helpers/0 2021-03-30T05:16:46.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: local 'ceph_args=--cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 ' 2021-03-30T05:16:46.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2021-03-30T05:16:46.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-journal-size=100' 2021-03-30T05:16:46.640 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2021-03-30T05:16:46.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-data=td/ceph-helpers/0' 2021-03-30T05:16:46.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-journal=td/ceph-helpers/0/journal' 2021-03-30T05:16:46.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --chdir=' 2021-03-30T05:16:46.641 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+= 2021-03-30T05:16:46.642 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --run-dir=td/ceph-helpers' 2021-03-30T05:16:46.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: get_asok_path 2021-03-30T05:16:46.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:46.642 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:46.642 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:46.643 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:46.643 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:46.643 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:46.643 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:46.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --debug-osd=20' 2021-03-30T05:16:46.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-ms=1' 2021-03-30T05:16:46.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-monc=20' 2021-03-30T05:16:46.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --log-file=td/ceph-helpers/$name.log' 2021-03-30T05:16:46.644 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --pid-file=td/ceph-helpers/$name.pid' 2021-03-30T05:16:46.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2021-03-30T05:16:46.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2021-03-30T05:16:46.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:46.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' ' 2021-03-30T05:16:46.645 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+= 2021-03-30T05:16:46.646 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: mkdir -p td/ceph-helpers/0 2021-03-30T05:16:46.646 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: uuidgen 2021-03-30T05:16:46.646 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: local uuid=c9b54f1a-6d25-4342-a624-e2c045f6bae2 2021-03-30T05:16:46.646 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: echo 'add osd0 c9b54f1a-6d25-4342-a624-e2c045f6bae2' 2021-03-30T05:16:46.647 INFO:tasks.workunit.client.0.smithi197.stdout:add osd0 c9b54f1a-6d25-4342-a624-e2c045f6bae2 2021-03-30T05:16:46.647 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: ceph-authtool --gen-print-key 2021-03-30T05:16:46.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: OSD_SECRET=AQA+tGJgkIzaJhAAD/NHZYYj+ZyEGnU1IpGCxg== 2021-03-30T05:16:46.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo '{"cephx_secret": "AQA+tGJgkIzaJhAAD/NHZYYj+ZyEGnU1IpGCxg=="}' 2021-03-30T05:16:46.652 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph osd new c9b54f1a-6d25-4342-a624-e2c045f6bae2 -i td/ceph-helpers/0/new.json 2021-03-30T05:16:47.190 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:47.199 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: rm td/ceph-helpers/0/new.json 2021-03-30T05:16:47.200 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQA+tGJgkIzaJhAAD/NHZYYj+ZyEGnU1IpGCxg== --osd-uuid c9b54f1a-6d25-4342-a624-e2c045f6bae2 2021-03-30T05:16:47.222 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.222+0000 7f9ec4b31f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:47.224 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.223+0000 7f9ec4b31f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:47.224 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.224+0000 7f9ec4b31f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:47.225 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.225+0000 7f9ec4b31f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:16:47.225 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.225+0000 7f9ec4b31f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:16:47.226 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.225+0000 7f9ec4b31f40 -1 bluestore(td/ceph-helpers/0/block) _read_bdev_label failed to open td/ceph-helpers/0/block: (2) No such file or directory 2021-03-30T05:16:47.262 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.262+0000 7f9ec4b31f40 -1 bluestore(td/ceph-helpers/0) _read_fsid unparsable uuid 2021-03-30T05:16:47.755 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:47.755+0000 7f9ec4b31f40 -1 freelist read_size_meta_from_db missing size meta in DB 2021-03-30T05:16:50.520 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: local key_fn=td/ceph-helpers/0/keyring 2021-03-30T05:16:50.521 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: cat 2021-03-30T05:16:50.521 INFO:tasks.workunit.client.0.smithi197.stdout:adding osd0 key to auth repository 2021-03-30T05:16:50.522 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:673: run_osd: echo adding osd0 key to auth repository 2021-03-30T05:16:50.522 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: ceph -i td/ceph-helpers/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2021-03-30T05:16:50.750 INFO:tasks.workunit.client.0.smithi197.stdout:start osd.0 2021-03-30T05:16:50.751 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo start osd.0 2021-03-30T05:16:50.751 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph-osd -i 0 --cluster ceph --fsid=56d309ad-176e-4c93-a3be-41f06f3ac8af --auth-supported=none --mon-host=127.0.0.1:7109 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ceph-helpers/0 --osd-journal=td/ceph-helpers/0/journal --chdir= --run-dir=td/ceph-helpers '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ceph-helpers/$name.log' '--pid-file=td/ceph-helpers/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2021-03-30T05:16:50.751 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: ceph osd dump --format=json 2021-03-30T05:16:50.752 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: jq '.flags_set[]' 2021-03-30T05:16:50.752 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:679: run_osd: grep -q '"noup"' 2021-03-30T05:16:50.771 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:50.770+0000 7f16e1195f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:50.772 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:50.772+0000 7f16e1195f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:50.774 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:50.774+0000 7f16e1195f40 -1 WARNING: all dangerous and experimental features are enabled. 2021-03-30T05:16:50.962 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:682: run_osd: wait_for_osd up 0 2021-03-30T05:16:50.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:916: wait_for_osd: local state=up 2021-03-30T05:16:50.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:917: wait_for_osd: local id=0 2021-03-30T05:16:50.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:919: wait_for_osd: status=1 2021-03-30T05:16:50.963 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i=0 )) 2021-03-30T05:16:50.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:50.964 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 0 2021-03-30T05:16:50.964 INFO:tasks.workunit.client.0.smithi197.stdout:0 2021-03-30T05:16:50.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:50.965 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:51.172 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:51.291 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:51.291+0000 7f16e1195f40 -1 Falling back to public interface 2021-03-30T05:16:52.035 INFO:tasks.workunit.client.0.smithi197.stderr:2021-03-30T05:16:52.034+0000 7f16e1195f40 -1 osd.0 0 log_to_monitors {default=true} 2021-03-30T05:16:52.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:52.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:52.174 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 1 2021-03-30T05:16:52.175 INFO:tasks.workunit.client.0.smithi197.stdout:1 2021-03-30T05:16:52.175 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:52.176 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:52.406 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:923: wait_for_osd: sleep 1 2021-03-30T05:16:53.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i++ )) 2021-03-30T05:16:53.408 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:920: wait_for_osd: (( i < 300 )) 2021-03-30T05:16:53.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:921: wait_for_osd: echo 2 2021-03-30T05:16:53.409 INFO:tasks.workunit.client.0.smithi197.stdout:2 2021-03-30T05:16:53.409 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: ceph osd dump 2021-03-30T05:16:53.410 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:922: wait_for_osd: grep 'osd.0 up' 2021-03-30T05:16:53.627 INFO:tasks.workunit.client.0.smithi197.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/74445,v1:127.0.0.1:6801/74445] [v2:127.0.0.1:6802/74445,v1:127.0.0.1:6803/74445] exists,up c9b54f1a-6d25-4342-a624-e2c045f6bae2 2021-03-30T05:16:53.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:925: wait_for_osd: status=0 2021-03-30T05:16:53.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:926: wait_for_osd: break 2021-03-30T05:16:53.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:929: wait_for_osd: return 0 2021-03-30T05:16:53.629 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1677: test_wait_for_peered: run_mgr td/ceph-helpers x 2021-03-30T05:16:53.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: local dir=td/ceph-helpers 2021-03-30T05:16:53.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: shift 2021-03-30T05:16:53.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: local id=x 2021-03-30T05:16:53.630 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: shift 2021-03-30T05:16:53.631 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: local data=td/ceph-helpers/x 2021-03-30T05:16:53.631 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:558: run_mgr: ceph config set mgr mgr/devicehealth/enable_monitoring off --force 2021-03-30T05:16:53.899 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: get_asok_path 2021-03-30T05:16:53.899 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2021-03-30T05:16:53.899 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2021-03-30T05:16:53.899 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2021-03-30T05:16:53.900 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2021-03-30T05:16:53.900 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.43807 2021-03-30T05:16:53.900 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.43807/$cluster-$name.asok' 2021-03-30T05:16:53.900 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:16:53.901 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:560: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ceph-helpers/x '--log-file=td/ceph-helpers/$name.log' '--admin-socket=/tmp/ceph-asok.43807/$cluster-$name.asok' --run-dir=td/ceph-helpers '--pid-file=td/ceph-helpers/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2021-03-30T05:16:53.920 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: test_wait_for_peered: create_rbd_pool 2021-03-30T05:16:53.920 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:534: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2021-03-30T05:16:54.135 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' does not exist 2021-03-30T05:16:54.143 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: create_pool rbd 4 2021-03-30T05:16:54.143 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:540: create_pool: ceph osd pool create rbd 4 2021-03-30T05:16:54.509 INFO:tasks.workunit.client.0.smithi197.stderr:pool 'rbd' already exists 2021-03-30T05:16:54.517 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: sleep 1 2021-03-30T05:16:55.518 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: rbd pool init rbd 2021-03-30T05:16:56.434 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: test_wait_for_peered: WAIT_FOR_CLEAN_TIMEOUT=1 2021-03-30T05:16:56.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: test_wait_for_peered: wait_for_clean 2021-03-30T05:16:56.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: wait_for_clean: local cmd= 2021-03-30T05:16:56.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1581: wait_for_clean: local num_active_clean=-1 2021-03-30T05:16:56.435 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1582: wait_for_clean: local cur_active_clean 2021-03-30T05:16:56.436 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: delays=($(get_timeout_delays $WAIT_FOR_CLEAN_TIMEOUT .1)) 2021-03-30T05:16:56.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: get_timeout_delays 1 .1 2021-03-30T05:16:56.436 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: shopt -q -o xtrace 2021-03-30T05:16:56.436 INFO:tasks.workunit.client.0.smithi197.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: echo true 2021-03-30T05:16:56.436 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1526: get_timeout_delays: local trace=true 2021-03-30T05:16:56.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: true 2021-03-30T05:16:56.437 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1527: get_timeout_delays: shopt -u -o xtrace 2021-03-30T05:16:56.460 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1583: wait_for_clean: local -a delays 2021-03-30T05:16:56.460 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1584: wait_for_clean: local -i loop=0 2021-03-30T05:16:56.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1586: wait_for_clean: flush_pg_stats 2021-03-30T05:16:56.461 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: flush_pg_stats: local timeout=300 2021-03-30T05:16:56.461 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ceph osd ls 2021-03-30T05:16:56.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: flush_pg_stats: ids=0 2021-03-30T05:16:56.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2070: flush_pg_stats: seqs= 2021-03-30T05:16:56.707 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: flush_pg_stats: for osd in $ids 2021-03-30T05:16:56.708 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2021-03-30T05:16:56.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2072: flush_pg_stats: seq=0 2021-03-30T05:16:56.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2073: flush_pg_stats: test -z 0 2021-03-30T05:16:56.836 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2077: flush_pg_stats: seqs=' 0-0' 2021-03-30T05:16:56.837 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2080: flush_pg_stats: for s in $seqs 2021-03-30T05:16:56.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: echo 0-0 2021-03-30T05:16:56.837 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: cut -d - -f 1 2021-03-30T05:16:56.838 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2081: flush_pg_stats: osd=0 2021-03-30T05:16:56.838 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: echo 0-0 2021-03-30T05:16:56.838 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: cut -d - -f 2 2021-03-30T05:16:56.839 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2082: flush_pg_stats: seq=0 2021-03-30T05:16:56.839 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2083: flush_pg_stats: echo 'waiting osd.0 seq 0' 2021-03-30T05:16:56.839 INFO:tasks.workunit.client.0.smithi197.stdout:waiting osd.0 seq 0 2021-03-30T05:16:56.840 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: ceph osd last-stat-seq 0 2021-03-30T05:16:57.057 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2084: flush_pg_stats: test 0 -lt 0 2021-03-30T05:16:57.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:16:57.058 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:16:57.059 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:16:57.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 0 == 0 2021-03-30T05:16:57.279 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1588: wait_for_clean: sleep 1 2021-03-30T05:16:58.280 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: get_num_pgs 2021-03-30T05:16:58.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:16:58.281 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:16:58.751 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1587: wait_for_clean: test 4 == 0 2021-03-30T05:16:58.751 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:16:58.751 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:16:58.752 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:16:58.752 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:16:58.752 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:16:58.752 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:16:58.753 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:16:59.127 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:16:59.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:16:59.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:16:59.127 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:16:59.604 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:16:59.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' -1 2021-03-30T05:16:59.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1598: wait_for_clean: loop=0 2021-03-30T05:16:59.605 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1599: wait_for_clean: num_active_clean=0 2021-03-30T05:16:59.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:16:59.606 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.1 2021-03-30T05:16:59.706 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:16:59.706 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:16:59.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:16:59.706 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:16:59.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:16:59.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:16:59.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:16:59.707 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:17:00.045 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:17:00.045 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:17:00.045 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:17:00.046 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:17:00.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:17:00.507 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:17:00.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:17:00.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:17:00.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:17:00.508 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:17:00.509 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:17:00.509 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:17:00.509 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:17:00.983 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:17:00.983 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:17:00.983 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 1 >= 4 )) 2021-03-30T05:17:00.984 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:17:00.984 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.2 2021-03-30T05:17:01.184 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:17:01.185 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:17:01.185 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:17:01.185 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:17:01.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:17:01.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:17:01.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:17:01.186 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:17:01.529 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:17:01.530 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:17:01.530 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:17:01.530 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:17:01.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:17:01.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:17:01.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:17:01.989 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:17:01.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:17:01.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:17:01.990 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:17:01.990 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:17:01.990 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:17:02.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:17:02.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:17:02.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 2 >= 4 )) 2021-03-30T05:17:02.466 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:17:02.467 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.4 2021-03-30T05:17:02.867 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:17:02.867 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:17:02.868 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:17:02.868 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:17:02.868 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:17:02.868 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:17:02.869 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:17:02.869 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:17:03.210 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:17:03.210 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:17:03.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:17:03.211 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:17:03.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:17:03.680 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:17:03.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:17:03.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:17:03.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:17:03.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:17:03.681 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:17:03.682 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:17:03.682 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:17:04.181 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:17:04.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:17:04.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 3 >= 4 )) 2021-03-30T05:17:04.182 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1607: wait_for_clean: eval 2021-03-30T05:17:04.183 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1608: wait_for_clean: sleep 0.3 2021-03-30T05:17:04.483 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1609: wait_for_clean: loop+=1 2021-03-30T05:17:04.483 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1591: wait_for_clean: true 2021-03-30T05:17:04.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: get_num_active_clean 2021-03-30T05:17:04.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1302: get_num_active_clean: local expression 2021-03-30T05:17:04.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1303: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2021-03-30T05:17:04.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1304: get_num_active_clean: expression+='select(contains("stale") | not)' 2021-03-30T05:17:04.484 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1305: get_num_active_clean: ceph --format json pg dump pgs 2021-03-30T05:17:04.485 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1306: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2021-03-30T05:17:04.825 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1595: wait_for_clean: cur_active_clean=0 2021-03-30T05:17:04.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: get_num_pgs 2021-03-30T05:17:04.825 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: ceph --format json status 2021-03-30T05:17:04.826 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1363: get_num_pgs: jq .pgmap.num_pgs 2021-03-30T05:17:05.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1596: wait_for_clean: test 0 = 4 2021-03-30T05:17:05.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1597: wait_for_clean: test 0 '!=' 0 2021-03-30T05:17:05.288 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1600: wait_for_clean: get_is_making_recovery_progress 2021-03-30T05:17:05.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1272: get_is_making_recovery_progress: local recovery_progress 2021-03-30T05:17:05.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1273: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2021-03-30T05:17:05.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1274: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2021-03-30T05:17:05.289 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1275: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2021-03-30T05:17:05.289 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: ceph --format json status 2021-03-30T05:17:05.290 INFO:tasks.workunit.client.0.smithi197.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2021-03-30T05:17:05.749 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1277: get_is_making_recovery_progress: local progress=null 2021-03-30T05:17:05.750 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1278: get_is_making_recovery_progress: test null '!=' null 2021-03-30T05:17:05.750 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: wait_for_clean: (( 4 >= 4 )) 2021-03-30T05:17:05.750 INFO:tasks.workunit.client.0.smithi197.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: wait_for_clean: ceph report 2021-03-30T05:17:06.222 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2021-03-30T05:17:06.222 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_fingerprint": "4c2547d8-57ac-47fb-8e75-12786c2e701f", 2021-03-30T05:17:06.223 INFO:tasks.workunit.client.0.smithi197.stdout: "version": "15.2.10-14-ge4949d65", 2021-03-30T05:17:06.223 INFO:tasks.workunit.client.0.smithi197.stdout: "commit": "e4949d651265114d7b464cd1e8986d9a31a26071", 2021-03-30T05:17:06.223 INFO:tasks.workunit.client.0.smithi197.stdout: "timestamp": "2021-03-30T05:17:06.221393+0000", 2021-03-30T05:17:06.223 INFO:tasks.workunit.client.0.smithi197.stdout: "tag": "", 2021-03-30T05:17:06.223 INFO:tasks.workunit.client.0.smithi197.stdout: "health": { 2021-03-30T05:17:06.224 INFO:tasks.workunit.client.0.smithi197.stdout: "status": "HEALTH_WARN", 2021-03-30T05:17:06.224 INFO:tasks.workunit.client.0.smithi197.stdout: "checks": { 2021-03-30T05:17:06.224 INFO:tasks.workunit.client.0.smithi197.stdout: "PG_DEGRADED": { 2021-03-30T05:17:06.224 INFO:tasks.workunit.client.0.smithi197.stdout: "severity": "HEALTH_WARN", 2021-03-30T05:17:06.224 INFO:tasks.workunit.client.0.smithi197.stdout: "summary": { 2021-03-30T05:17:06.225 INFO:tasks.workunit.client.0.smithi197.stdout: "message": "Degraded data redundancy: 1/2 objects degraded (50.000%), 1 pg degraded", 2021-03-30T05:17:06.225 INFO:tasks.workunit.client.0.smithi197.stdout: "count": 1 2021-03-30T05:17:06.225 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.225 INFO:tasks.workunit.client.0.smithi197.stdout: "detail": [ 2021-03-30T05:17:06.225 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.226 INFO:tasks.workunit.client.0.smithi197.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0]" 2021-03-30T05:17:06.226 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.226 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.226 INFO:tasks.workunit.client.0.smithi197.stdout: "muted": false 2021-03-30T05:17:06.226 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.227 INFO:tasks.workunit.client.0.smithi197.stdout: "TOO_FEW_OSDS": { 2021-03-30T05:17:06.227 INFO:tasks.workunit.client.0.smithi197.stdout: "severity": "HEALTH_WARN", 2021-03-30T05:17:06.227 INFO:tasks.workunit.client.0.smithi197.stdout: "summary": { 2021-03-30T05:17:06.227 INFO:tasks.workunit.client.0.smithi197.stdout: "message": "OSD count 1 < osd_pool_default_size 3", 2021-03-30T05:17:06.227 INFO:tasks.workunit.client.0.smithi197.stdout: "count": 2 2021-03-30T05:17:06.228 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.228 INFO:tasks.workunit.client.0.smithi197.stdout: "detail": [], 2021-03-30T05:17:06.228 INFO:tasks.workunit.client.0.smithi197.stdout: "muted": false 2021-03-30T05:17:06.228 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.228 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.229 INFO:tasks.workunit.client.0.smithi197.stdout: "mutes": [] 2021-03-30T05:17:06.229 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.229 INFO:tasks.workunit.client.0.smithi197.stdout: "monmap_first_committed": 1, 2021-03-30T05:17:06.229 INFO:tasks.workunit.client.0.smithi197.stdout: "monmap_last_committed": 1, 2021-03-30T05:17:06.229 INFO:tasks.workunit.client.0.smithi197.stdout: "monmap": { 2021-03-30T05:17:06.230 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 1, 2021-03-30T05:17:06.230 INFO:tasks.workunit.client.0.smithi197.stdout: "fsid": "56d309ad-176e-4c93-a3be-41f06f3ac8af", 2021-03-30T05:17:06.230 INFO:tasks.workunit.client.0.smithi197.stdout: "modified": "2021-03-30T05:16:45.948567Z", 2021-03-30T05:17:06.230 INFO:tasks.workunit.client.0.smithi197.stdout: "created": "2021-03-30T05:16:45.948567Z", 2021-03-30T05:17:06.230 INFO:tasks.workunit.client.0.smithi197.stdout: "min_mon_release": 15, 2021-03-30T05:17:06.231 INFO:tasks.workunit.client.0.smithi197.stdout: "min_mon_release_name": "octopus", 2021-03-30T05:17:06.231 INFO:tasks.workunit.client.0.smithi197.stdout: "features": { 2021-03-30T05:17:06.231 INFO:tasks.workunit.client.0.smithi197.stdout: "persistent": [ 2021-03-30T05:17:06.231 INFO:tasks.workunit.client.0.smithi197.stdout: "kraken", 2021-03-30T05:17:06.231 INFO:tasks.workunit.client.0.smithi197.stdout: "luminous", 2021-03-30T05:17:06.232 INFO:tasks.workunit.client.0.smithi197.stdout: "mimic", 2021-03-30T05:17:06.232 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap-prune", 2021-03-30T05:17:06.232 INFO:tasks.workunit.client.0.smithi197.stdout: "nautilus", 2021-03-30T05:17:06.232 INFO:tasks.workunit.client.0.smithi197.stdout: "octopus" 2021-03-30T05:17:06.232 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.233 INFO:tasks.workunit.client.0.smithi197.stdout: "optional": [] 2021-03-30T05:17:06.233 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.233 INFO:tasks.workunit.client.0.smithi197.stdout: "mons": [ 2021-03-30T05:17:06.233 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.233 INFO:tasks.workunit.client.0.smithi197.stdout: "rank": 0, 2021-03-30T05:17:06.234 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "a", 2021-03-30T05:17:06.234 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addrs": { 2021-03-30T05:17:06.234 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:17:06.234 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.234 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:17:06.235 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:7109", 2021-03-30T05:17:06.235 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 0 2021-03-30T05:17:06.235 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.235 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.235 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.236 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:7109/0", 2021-03-30T05:17:06.236 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addr": "127.0.0.1:7109/0", 2021-03-30T05:17:06.236 INFO:tasks.workunit.client.0.smithi197.stdout: "priority": 0, 2021-03-30T05:17:06.236 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 0 2021-03-30T05:17:06.236 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.237 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.237 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.237 INFO:tasks.workunit.client.0.smithi197.stdout: "quorum": [ 2021-03-30T05:17:06.237 INFO:tasks.workunit.client.0.smithi197.stdout: 0 2021-03-30T05:17:06.237 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.237 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap": { 2021-03-30T05:17:06.238 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 12, 2021-03-30T05:17:06.238 INFO:tasks.workunit.client.0.smithi197.stdout: "fsid": "56d309ad-176e-4c93-a3be-41f06f3ac8af", 2021-03-30T05:17:06.238 INFO:tasks.workunit.client.0.smithi197.stdout: "created": "2021-03-30T05:16:46.702489+0000", 2021-03-30T05:17:06.238 INFO:tasks.workunit.client.0.smithi197.stdout: "modified": "2021-03-30T05:16:56.147153+0000", 2021-03-30T05:17:06.239 INFO:tasks.workunit.client.0.smithi197.stdout: "last_up_change": "2021-03-30T05:16:52.648431+0000", 2021-03-30T05:17:06.239 INFO:tasks.workunit.client.0.smithi197.stdout: "last_in_change": "2021-03-30T05:16:52.648431+0000", 2021-03-30T05:17:06.239 INFO:tasks.workunit.client.0.smithi197.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-03-30T05:17:06.239 INFO:tasks.workunit.client.0.smithi197.stdout: "flags_num": 5799936, 2021-03-30T05:17:06.239 INFO:tasks.workunit.client.0.smithi197.stdout: "flags_set": [ 2021-03-30T05:17:06.240 INFO:tasks.workunit.client.0.smithi197.stdout: "pglog_hardlimit", 2021-03-30T05:17:06.240 INFO:tasks.workunit.client.0.smithi197.stdout: "purged_snapdirs", 2021-03-30T05:17:06.240 INFO:tasks.workunit.client.0.smithi197.stdout: "recovery_deletes", 2021-03-30T05:17:06.240 INFO:tasks.workunit.client.0.smithi197.stdout: "sortbitwise" 2021-03-30T05:17:06.240 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.240 INFO:tasks.workunit.client.0.smithi197.stdout: "crush_version": 3, 2021-03-30T05:17:06.241 INFO:tasks.workunit.client.0.smithi197.stdout: "full_ratio": 0.99000000953674316, 2021-03-30T05:17:06.241 INFO:tasks.workunit.client.0.smithi197.stdout: "backfillfull_ratio": 0.99000000953674316, 2021-03-30T05:17:06.241 INFO:tasks.workunit.client.0.smithi197.stdout: "nearfull_ratio": 0.85000002384185791, 2021-03-30T05:17:06.241 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_snapshot": "", 2021-03-30T05:17:06.241 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_max": 1, 2021-03-30T05:17:06.242 INFO:tasks.workunit.client.0.smithi197.stdout: "max_osd": 1, 2021-03-30T05:17:06.242 INFO:tasks.workunit.client.0.smithi197.stdout: "require_min_compat_client": "jewel", 2021-03-30T05:17:06.242 INFO:tasks.workunit.client.0.smithi197.stdout: "min_compat_client": "jewel", 2021-03-30T05:17:06.242 INFO:tasks.workunit.client.0.smithi197.stdout: "require_osd_release": "octopus", 2021-03-30T05:17:06.242 INFO:tasks.workunit.client.0.smithi197.stdout: "pools": [ 2021-03-30T05:17:06.243 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.243 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": 1, 2021-03-30T05:17:06.243 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_name": "rbd", 2021-03-30T05:17:06.243 INFO:tasks.workunit.client.0.smithi197.stdout: "create_time": "2021-03-30T05:16:54.320786+0000", 2021-03-30T05:17:06.243 INFO:tasks.workunit.client.0.smithi197.stdout: "flags": 8193, 2021-03-30T05:17:06.244 INFO:tasks.workunit.client.0.smithi197.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2021-03-30T05:17:06.244 INFO:tasks.workunit.client.0.smithi197.stdout: "type": 1, 2021-03-30T05:17:06.244 INFO:tasks.workunit.client.0.smithi197.stdout: "size": 2, 2021-03-30T05:17:06.244 INFO:tasks.workunit.client.0.smithi197.stdout: "min_size": 1, 2021-03-30T05:17:06.244 INFO:tasks.workunit.client.0.smithi197.stdout: "crush_rule": 0, 2021-03-30T05:17:06.245 INFO:tasks.workunit.client.0.smithi197.stdout: "object_hash": 2, 2021-03-30T05:17:06.245 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_autoscale_mode": "off", 2021-03-30T05:17:06.245 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_num": 4, 2021-03-30T05:17:06.245 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_placement_num": 4, 2021-03-30T05:17:06.245 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_placement_num_target": 4, 2021-03-30T05:17:06.245 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_num_target": 4, 2021-03-30T05:17:06.246 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_num_pending": 4, 2021-03-30T05:17:06.246 INFO:tasks.workunit.client.0.smithi197.stdout: "last_pg_merge_meta": { 2021-03-30T05:17:06.246 INFO:tasks.workunit.client.0.smithi197.stdout: "source_pgid": "0.0", 2021-03-30T05:17:06.246 INFO:tasks.workunit.client.0.smithi197.stdout: "ready_epoch": 0, 2021-03-30T05:17:06.246 INFO:tasks.workunit.client.0.smithi197.stdout: "last_epoch_started": 0, 2021-03-30T05:17:06.247 INFO:tasks.workunit.client.0.smithi197.stdout: "last_epoch_clean": 0, 2021-03-30T05:17:06.247 INFO:tasks.workunit.client.0.smithi197.stdout: "source_version": "0'0", 2021-03-30T05:17:06.247 INFO:tasks.workunit.client.0.smithi197.stdout: "target_version": "0'0" 2021-03-30T05:17:06.247 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.247 INFO:tasks.workunit.client.0.smithi197.stdout: "last_change": "12", 2021-03-30T05:17:06.248 INFO:tasks.workunit.client.0.smithi197.stdout: "last_force_op_resend": "0", 2021-03-30T05:17:06.248 INFO:tasks.workunit.client.0.smithi197.stdout: "last_force_op_resend_prenautilus": "0", 2021-03-30T05:17:06.248 INFO:tasks.workunit.client.0.smithi197.stdout: "last_force_op_resend_preluminous": "0", 2021-03-30T05:17:06.248 INFO:tasks.workunit.client.0.smithi197.stdout: "auid": 0, 2021-03-30T05:17:06.248 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_mode": "selfmanaged", 2021-03-30T05:17:06.249 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_seq": 3, 2021-03-30T05:17:06.249 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_epoch": 12, 2021-03-30T05:17:06.249 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_snaps": [], 2021-03-30T05:17:06.249 INFO:tasks.workunit.client.0.smithi197.stdout: "removed_snaps": "[]", 2021-03-30T05:17:06.249 INFO:tasks.workunit.client.0.smithi197.stdout: "quota_max_bytes": 0, 2021-03-30T05:17:06.250 INFO:tasks.workunit.client.0.smithi197.stdout: "quota_max_objects": 0, 2021-03-30T05:17:06.250 INFO:tasks.workunit.client.0.smithi197.stdout: "tiers": [], 2021-03-30T05:17:06.250 INFO:tasks.workunit.client.0.smithi197.stdout: "tier_of": -1, 2021-03-30T05:17:06.250 INFO:tasks.workunit.client.0.smithi197.stdout: "read_tier": -1, 2021-03-30T05:17:06.251 INFO:tasks.workunit.client.0.smithi197.stdout: "write_tier": -1, 2021-03-30T05:17:06.251 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_mode": "none", 2021-03-30T05:17:06.251 INFO:tasks.workunit.client.0.smithi197.stdout: "target_max_bytes": 0, 2021-03-30T05:17:06.251 INFO:tasks.workunit.client.0.smithi197.stdout: "target_max_objects": 0, 2021-03-30T05:17:06.251 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-03-30T05:17:06.252 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-03-30T05:17:06.252 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_target_full_ratio_micro": 800000, 2021-03-30T05:17:06.252 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_min_flush_age": 0, 2021-03-30T05:17:06.252 INFO:tasks.workunit.client.0.smithi197.stdout: "cache_min_evict_age": 0, 2021-03-30T05:17:06.252 INFO:tasks.workunit.client.0.smithi197.stdout: "erasure_code_profile": "", 2021-03-30T05:17:06.253 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_params": { 2021-03-30T05:17:06.253 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "none" 2021-03-30T05:17:06.253 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.253 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_period": 0, 2021-03-30T05:17:06.253 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_count": 0, 2021-03-30T05:17:06.254 INFO:tasks.workunit.client.0.smithi197.stdout: "use_gmt_hitset": true, 2021-03-30T05:17:06.254 INFO:tasks.workunit.client.0.smithi197.stdout: "min_read_recency_for_promote": 0, 2021-03-30T05:17:06.254 INFO:tasks.workunit.client.0.smithi197.stdout: "min_write_recency_for_promote": 0, 2021-03-30T05:17:06.254 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_grade_decay_rate": 0, 2021-03-30T05:17:06.255 INFO:tasks.workunit.client.0.smithi197.stdout: "hit_set_search_last_n": 0, 2021-03-30T05:17:06.255 INFO:tasks.workunit.client.0.smithi197.stdout: "grade_table": [], 2021-03-30T05:17:06.255 INFO:tasks.workunit.client.0.smithi197.stdout: "stripe_width": 0, 2021-03-30T05:17:06.255 INFO:tasks.workunit.client.0.smithi197.stdout: "expected_num_objects": 0, 2021-03-30T05:17:06.255 INFO:tasks.workunit.client.0.smithi197.stdout: "fast_read": false, 2021-03-30T05:17:06.256 INFO:tasks.workunit.client.0.smithi197.stdout: "options": {}, 2021-03-30T05:17:06.256 INFO:tasks.workunit.client.0.smithi197.stdout: "application_metadata": { 2021-03-30T05:17:06.256 INFO:tasks.workunit.client.0.smithi197.stdout: "rbd": {} 2021-03-30T05:17:06.256 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.256 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.257 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.257 INFO:tasks.workunit.client.0.smithi197.stdout: "osds": [ 2021-03-30T05:17:06.257 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.257 INFO:tasks.workunit.client.0.smithi197.stdout: "osd": 0, 2021-03-30T05:17:06.257 INFO:tasks.workunit.client.0.smithi197.stdout: "uuid": "c9b54f1a-6d25-4342-a624-e2c045f6bae2", 2021-03-30T05:17:06.258 INFO:tasks.workunit.client.0.smithi197.stdout: "up": 1, 2021-03-30T05:17:06.258 INFO:tasks.workunit.client.0.smithi197.stdout: "in": 1, 2021-03-30T05:17:06.258 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 1, 2021-03-30T05:17:06.258 INFO:tasks.workunit.client.0.smithi197.stdout: "primary_affinity": 1, 2021-03-30T05:17:06.258 INFO:tasks.workunit.client.0.smithi197.stdout: "last_clean_begin": 0, 2021-03-30T05:17:06.259 INFO:tasks.workunit.client.0.smithi197.stdout: "last_clean_end": 0, 2021-03-30T05:17:06.259 INFO:tasks.workunit.client.0.smithi197.stdout: "up_from": 5, 2021-03-30T05:17:06.259 INFO:tasks.workunit.client.0.smithi197.stdout: "up_thru": 7, 2021-03-30T05:17:06.259 INFO:tasks.workunit.client.0.smithi197.stdout: "down_at": 0, 2021-03-30T05:17:06.259 INFO:tasks.workunit.client.0.smithi197.stdout: "lost_at": 0, 2021-03-30T05:17:06.260 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addrs": { 2021-03-30T05:17:06.260 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:17:06.260 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.260 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:17:06.261 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6800", 2021-03-30T05:17:06.261 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.261 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.261 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.261 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:17:06.262 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6801", 2021-03-30T05:17:06.262 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.262 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.262 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.262 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.263 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_addrs": { 2021-03-30T05:17:06.263 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:17:06.263 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.263 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:17:06.263 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6802", 2021-03-30T05:17:06.264 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.264 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.264 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.264 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:17:06.264 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6803", 2021-03-30T05:17:06.265 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.265 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.265 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.265 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.265 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_back_addrs": { 2021-03-30T05:17:06.266 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:17:06.266 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.266 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:17:06.266 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6806", 2021-03-30T05:17:06.266 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.267 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.267 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.267 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:17:06.267 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6807", 2021-03-30T05:17:06.268 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.268 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.268 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.268 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.268 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_front_addrs": { 2021-03-30T05:17:06.269 INFO:tasks.workunit.client.0.smithi197.stdout: "addrvec": [ 2021-03-30T05:17:06.269 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.269 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v2", 2021-03-30T05:17:06.269 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6804", 2021-03-30T05:17:06.269 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.270 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.270 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.270 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "v1", 2021-03-30T05:17:06.270 INFO:tasks.workunit.client.0.smithi197.stdout: "addr": "127.0.0.1:6805", 2021-03-30T05:17:06.270 INFO:tasks.workunit.client.0.smithi197.stdout: "nonce": 74445 2021-03-30T05:17:06.271 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.271 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.271 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.271 INFO:tasks.workunit.client.0.smithi197.stdout: "public_addr": "127.0.0.1:6801/74445", 2021-03-30T05:17:06.271 INFO:tasks.workunit.client.0.smithi197.stdout: "cluster_addr": "127.0.0.1:6803/74445", 2021-03-30T05:17:06.272 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_back_addr": "127.0.0.1:6807/74445", 2021-03-30T05:17:06.272 INFO:tasks.workunit.client.0.smithi197.stdout: "heartbeat_front_addr": "127.0.0.1:6805/74445", 2021-03-30T05:17:06.272 INFO:tasks.workunit.client.0.smithi197.stdout: "state": [ 2021-03-30T05:17:06.272 INFO:tasks.workunit.client.0.smithi197.stdout: "exists", 2021-03-30T05:17:06.272 INFO:tasks.workunit.client.0.smithi197.stdout: "up" 2021-03-30T05:17:06.273 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.273 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.273 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.273 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_xinfo": [ 2021-03-30T05:17:06.273 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.274 INFO:tasks.workunit.client.0.smithi197.stdout: "osd": 0, 2021-03-30T05:17:06.274 INFO:tasks.workunit.client.0.smithi197.stdout: "down_stamp": "0.000000", 2021-03-30T05:17:06.274 INFO:tasks.workunit.client.0.smithi197.stdout: "laggy_probability": 0, 2021-03-30T05:17:06.274 INFO:tasks.workunit.client.0.smithi197.stdout: "laggy_interval": 0, 2021-03-30T05:17:06.274 INFO:tasks.workunit.client.0.smithi197.stdout: "features": 4540138292840890367, 2021-03-30T05:17:06.275 INFO:tasks.workunit.client.0.smithi197.stdout: "old_weight": 0, 2021-03-30T05:17:06.275 INFO:tasks.workunit.client.0.smithi197.stdout: "last_purged_snaps_scrub": "2021-03-30T05:16:53.005013+0000", 2021-03-30T05:17:06.275 INFO:tasks.workunit.client.0.smithi197.stdout: "dead_epoch": 0 2021-03-30T05:17:06.275 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.275 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.276 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_upmap": [], 2021-03-30T05:17:06.276 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_upmap_items": [], 2021-03-30T05:17:06.276 INFO:tasks.workunit.client.0.smithi197.stdout: "pg_temp": [], 2021-03-30T05:17:06.276 INFO:tasks.workunit.client.0.smithi197.stdout: "primary_temp": [], 2021-03-30T05:17:06.276 INFO:tasks.workunit.client.0.smithi197.stdout: "blacklist": {}, 2021-03-30T05:17:06.277 INFO:tasks.workunit.client.0.smithi197.stdout: "erasure_code_profiles": { 2021-03-30T05:17:06.277 INFO:tasks.workunit.client.0.smithi197.stdout: "default": { 2021-03-30T05:17:06.277 INFO:tasks.workunit.client.0.smithi197.stdout: "k": "2", 2021-03-30T05:17:06.277 INFO:tasks.workunit.client.0.smithi197.stdout: "m": "2", 2021-03-30T05:17:06.277 INFO:tasks.workunit.client.0.smithi197.stdout: "plugin": "jerasure", 2021-03-30T05:17:06.278 INFO:tasks.workunit.client.0.smithi197.stdout: "technique": "reed_sol_van" 2021-03-30T05:17:06.278 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.278 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.278 INFO:tasks.workunit.client.0.smithi197.stdout: "removed_snaps_queue": [ 2021-03-30T05:17:06.278 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.279 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": 1, 2021-03-30T05:17:06.279 INFO:tasks.workunit.client.0.smithi197.stdout: "snaps": [ 2021-03-30T05:17:06.279 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.279 INFO:tasks.workunit.client.0.smithi197.stdout: "begin": 2, 2021-03-30T05:17:06.279 INFO:tasks.workunit.client.0.smithi197.stdout: "length": 1 2021-03-30T05:17:06.280 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.280 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.280 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.280 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.280 INFO:tasks.workunit.client.0.smithi197.stdout: "new_removed_snaps": [ 2021-03-30T05:17:06.281 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.281 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": 1, 2021-03-30T05:17:06.281 INFO:tasks.workunit.client.0.smithi197.stdout: "snaps": [ 2021-03-30T05:17:06.281 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.282 INFO:tasks.workunit.client.0.smithi197.stdout: "begin": 2, 2021-03-30T05:17:06.282 INFO:tasks.workunit.client.0.smithi197.stdout: "length": 1 2021-03-30T05:17:06.282 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.282 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.282 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.283 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.283 INFO:tasks.workunit.client.0.smithi197.stdout: "new_purged_snaps": [], 2021-03-30T05:17:06.283 INFO:tasks.workunit.client.0.smithi197.stdout: "crush_node_flags": {}, 2021-03-30T05:17:06.283 INFO:tasks.workunit.client.0.smithi197.stdout: "device_class_flags": {} 2021-03-30T05:17:06.283 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.284 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_metadata": [ 2021-03-30T05:17:06.284 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.284 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:17:06.284 INFO:tasks.workunit.client.0.smithi197.stdout: "arch": "x86_64", 2021-03-30T05:17:06.284 INFO:tasks.workunit.client.0.smithi197.stdout: "back_addr": "[v2:127.0.0.1:6802/74445,v1:127.0.0.1:6803/74445]", 2021-03-30T05:17:06.285 INFO:tasks.workunit.client.0.smithi197.stdout: "back_iface": "", 2021-03-30T05:17:06.285 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs": "1", 2021-03-30T05:17:06.285 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs_dedicated_db": "0", 2021-03-30T05:17:06.285 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs_dedicated_wal": "0", 2021-03-30T05:17:06.285 INFO:tasks.workunit.client.0.smithi197.stdout: "bluefs_single_shared_device": "1", 2021-03-30T05:17:06.286 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_access_mode": "file", 2021-03-30T05:17:06.286 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_block_size": "4096", 2021-03-30T05:17:06.286 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_devices": "sda", 2021-03-30T05:17:06.286 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_driver": "KernelDevice", 2021-03-30T05:17:06.286 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_path": "td/ceph-helpers/0/block", 2021-03-30T05:17:06.287 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_rotational": "1", 2021-03-30T05:17:06.287 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_size": "107374182400", 2021-03-30T05:17:06.287 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_support_discard": "0", 2021-03-30T05:17:06.287 INFO:tasks.workunit.client.0.smithi197.stdout: "bluestore_bdev_type": "hdd", 2021-03-30T05:17:06.287 INFO:tasks.workunit.client.0.smithi197.stdout: "ceph_release": "octopus", 2021-03-30T05:17:06.288 INFO:tasks.workunit.client.0.smithi197.stdout: "ceph_version": "ceph version 15.2.10-14-ge4949d65 (e4949d651265114d7b464cd1e8986d9a31a26071) octopus (stable)", 2021-03-30T05:17:06.288 INFO:tasks.workunit.client.0.smithi197.stdout: "ceph_version_short": "15.2.10-14-ge4949d65", 2021-03-30T05:17:06.288 INFO:tasks.workunit.client.0.smithi197.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-03-30T05:17:06.288 INFO:tasks.workunit.client.0.smithi197.stdout: "default_device_class": "hdd", 2021-03-30T05:17:06.289 INFO:tasks.workunit.client.0.smithi197.stdout: "device_ids": "sda=ST1000NM0033-9ZM_Z1W5XK3R", 2021-03-30T05:17:06.289 INFO:tasks.workunit.client.0.smithi197.stdout: "device_paths": "sda=/dev/disk/by-path/pci-0000:00:1f.2-ata-1", 2021-03-30T05:17:06.289 INFO:tasks.workunit.client.0.smithi197.stdout: "devices": "sda", 2021-03-30T05:17:06.289 INFO:tasks.workunit.client.0.smithi197.stdout: "distro": "rhel", 2021-03-30T05:17:06.289 INFO:tasks.workunit.client.0.smithi197.stdout: "distro_description": "Red Hat Enterprise Linux 8.2 (Ootpa)", 2021-03-30T05:17:06.290 INFO:tasks.workunit.client.0.smithi197.stdout: "distro_version": "8.2", 2021-03-30T05:17:06.290 INFO:tasks.workunit.client.0.smithi197.stdout: "front_addr": "[v2:127.0.0.1:6800/74445,v1:127.0.0.1:6801/74445]", 2021-03-30T05:17:06.290 INFO:tasks.workunit.client.0.smithi197.stdout: "front_iface": "", 2021-03-30T05:17:06.290 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/74445,v1:127.0.0.1:6807/74445]", 2021-03-30T05:17:06.290 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/74445,v1:127.0.0.1:6805/74445]", 2021-03-30T05:17:06.291 INFO:tasks.workunit.client.0.smithi197.stdout: "hostname": "smithi197", 2021-03-30T05:17:06.291 INFO:tasks.workunit.client.0.smithi197.stdout: "journal_rotational": "1", 2021-03-30T05:17:06.291 INFO:tasks.workunit.client.0.smithi197.stdout: "kernel_description": "#1 SMP Wed Feb 3 03:12:15 EST 2021", 2021-03-30T05:17:06.291 INFO:tasks.workunit.client.0.smithi197.stdout: "kernel_version": "4.18.0-240.15.1.el8_3.x86_64", 2021-03-30T05:17:06.291 INFO:tasks.workunit.client.0.smithi197.stdout: "mem_swap_kb": "0", 2021-03-30T05:17:06.292 INFO:tasks.workunit.client.0.smithi197.stdout: "mem_total_kb": "32612076", 2021-03-30T05:17:06.292 INFO:tasks.workunit.client.0.smithi197.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2021-03-30T05:17:06.292 INFO:tasks.workunit.client.0.smithi197.stdout: "objectstore_numa_unknown_devices": "sda", 2021-03-30T05:17:06.292 INFO:tasks.workunit.client.0.smithi197.stdout: "os": "Linux", 2021-03-30T05:17:06.292 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_data": "td/ceph-helpers/0", 2021-03-30T05:17:06.293 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_objectstore": "bluestore", 2021-03-30T05:17:06.293 INFO:tasks.workunit.client.0.smithi197.stdout: "osdspec_affinity": "", 2021-03-30T05:17:06.293 INFO:tasks.workunit.client.0.smithi197.stdout: "rotational": "1" 2021-03-30T05:17:06.293 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.294 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.294 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap_clean_epochs": { 2021-03-30T05:17:06.294 INFO:tasks.workunit.client.0.smithi197.stdout: "min_last_epoch_clean": 0, 2021-03-30T05:17:06.294 INFO:tasks.workunit.client.0.smithi197.stdout: "last_epoch_clean": { 2021-03-30T05:17:06.294 INFO:tasks.workunit.client.0.smithi197.stdout: "per_pool": [] 2021-03-30T05:17:06.295 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.295 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_epochs": [ 2021-03-30T05:17:06.295 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.295 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:17:06.295 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 5 2021-03-30T05:17:06.296 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.296 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.296 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.296 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap_first_committed": 1, 2021-03-30T05:17:06.297 INFO:tasks.workunit.client.0.smithi197.stdout: "osdmap_last_committed": 12, 2021-03-30T05:17:06.297 INFO:tasks.workunit.client.0.smithi197.stdout: "crushmap": { 2021-03-30T05:17:06.297 INFO:tasks.workunit.client.0.smithi197.stdout: "devices": [ 2021-03-30T05:17:06.297 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.297 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:17:06.298 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "osd.0", 2021-03-30T05:17:06.298 INFO:tasks.workunit.client.0.smithi197.stdout: "class": "hdd" 2021-03-30T05:17:06.298 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.298 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.298 INFO:tasks.workunit.client.0.smithi197.stdout: "types": [ 2021-03-30T05:17:06.299 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.299 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 0, 2021-03-30T05:17:06.299 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "osd" 2021-03-30T05:17:06.299 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.300 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.300 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 1, 2021-03-30T05:17:06.300 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "host" 2021-03-30T05:17:06.300 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.300 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.301 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 2, 2021-03-30T05:17:06.301 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "chassis" 2021-03-30T05:17:06.301 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.301 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.301 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 3, 2021-03-30T05:17:06.302 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "rack" 2021-03-30T05:17:06.302 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.302 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.302 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 4, 2021-03-30T05:17:06.302 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "row" 2021-03-30T05:17:06.303 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.303 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.303 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 5, 2021-03-30T05:17:06.303 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "pdu" 2021-03-30T05:17:06.303 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.304 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.304 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 6, 2021-03-30T05:17:06.304 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "pod" 2021-03-30T05:17:06.304 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.305 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.305 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 7, 2021-03-30T05:17:06.305 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "room" 2021-03-30T05:17:06.305 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.305 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.306 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 8, 2021-03-30T05:17:06.306 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "datacenter" 2021-03-30T05:17:06.306 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.306 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.306 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 9, 2021-03-30T05:17:06.307 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "zone" 2021-03-30T05:17:06.307 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.307 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.307 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 10, 2021-03-30T05:17:06.307 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "region" 2021-03-30T05:17:06.308 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.308 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.308 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 11, 2021-03-30T05:17:06.308 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "root" 2021-03-30T05:17:06.309 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.309 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.309 INFO:tasks.workunit.client.0.smithi197.stdout: "buckets": [ 2021-03-30T05:17:06.309 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.309 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -1, 2021-03-30T05:17:06.309 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "default", 2021-03-30T05:17:06.310 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 11, 2021-03-30T05:17:06.310 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "root", 2021-03-30T05:17:06.310 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.310 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:17:06.310 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:17:06.311 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:17:06.311 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.311 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -3, 2021-03-30T05:17:06.311 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.312 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:17:06.312 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.312 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.312 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.312 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.313 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -2, 2021-03-30T05:17:06.313 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "default~hdd", 2021-03-30T05:17:06.313 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 11, 2021-03-30T05:17:06.313 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "root", 2021-03-30T05:17:06.313 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.314 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:17:06.314 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:17:06.314 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:17:06.314 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.314 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -4, 2021-03-30T05:17:06.315 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.315 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:17:06.315 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.315 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.316 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.316 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.316 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -3, 2021-03-30T05:17:06.316 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "smithi197", 2021-03-30T05:17:06.316 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 1, 2021-03-30T05:17:06.317 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "host", 2021-03-30T05:17:06.317 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.317 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:17:06.317 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:17:06.317 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:17:06.318 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.318 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:17:06.318 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.318 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:17:06.318 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.319 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.319 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.319 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.319 INFO:tasks.workunit.client.0.smithi197.stdout: "id": -4, 2021-03-30T05:17:06.320 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "smithi197~hdd", 2021-03-30T05:17:06.320 INFO:tasks.workunit.client.0.smithi197.stdout: "type_id": 1, 2021-03-30T05:17:06.320 INFO:tasks.workunit.client.0.smithi197.stdout: "type_name": "host", 2021-03-30T05:17:06.320 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.320 INFO:tasks.workunit.client.0.smithi197.stdout: "alg": "straw2", 2021-03-30T05:17:06.321 INFO:tasks.workunit.client.0.smithi197.stdout: "hash": "rjenkins1", 2021-03-30T05:17:06.321 INFO:tasks.workunit.client.0.smithi197.stdout: "items": [ 2021-03-30T05:17:06.321 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.321 INFO:tasks.workunit.client.0.smithi197.stdout: "id": 0, 2021-03-30T05:17:06.321 INFO:tasks.workunit.client.0.smithi197.stdout: "weight": 6402, 2021-03-30T05:17:06.322 INFO:tasks.workunit.client.0.smithi197.stdout: "pos": 0 2021-03-30T05:17:06.322 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.322 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.322 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.322 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.323 INFO:tasks.workunit.client.0.smithi197.stdout: "rules": [ 2021-03-30T05:17:06.323 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.323 INFO:tasks.workunit.client.0.smithi197.stdout: "rule_id": 0, 2021-03-30T05:17:06.323 INFO:tasks.workunit.client.0.smithi197.stdout: "rule_name": "replicated_rule", 2021-03-30T05:17:06.323 INFO:tasks.workunit.client.0.smithi197.stdout: "ruleset": 0, 2021-03-30T05:17:06.324 INFO:tasks.workunit.client.0.smithi197.stdout: "type": 1, 2021-03-30T05:17:06.324 INFO:tasks.workunit.client.0.smithi197.stdout: "min_size": 1, 2021-03-30T05:17:06.324 INFO:tasks.workunit.client.0.smithi197.stdout: "max_size": 10, 2021-03-30T05:17:06.324 INFO:tasks.workunit.client.0.smithi197.stdout: "steps": [ 2021-03-30T05:17:06.324 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.325 INFO:tasks.workunit.client.0.smithi197.stdout: "op": "take", 2021-03-30T05:17:06.325 INFO:tasks.workunit.client.0.smithi197.stdout: "item": -1, 2021-03-30T05:17:06.325 INFO:tasks.workunit.client.0.smithi197.stdout: "item_name": "default" 2021-03-30T05:17:06.325 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.325 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.326 INFO:tasks.workunit.client.0.smithi197.stdout: "op": "choose_firstn", 2021-03-30T05:17:06.326 INFO:tasks.workunit.client.0.smithi197.stdout: "num": 0, 2021-03-30T05:17:06.326 INFO:tasks.workunit.client.0.smithi197.stdout: "type": "osd" 2021-03-30T05:17:06.326 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.326 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.326 INFO:tasks.workunit.client.0.smithi197.stdout: "op": "emit" 2021-03-30T05:17:06.327 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.327 INFO:tasks.workunit.client.0.smithi197.stdout: ] 2021-03-30T05:17:06.327 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.327 INFO:tasks.workunit.client.0.smithi197.stdout: ], 2021-03-30T05:17:06.328 INFO:tasks.workunit.client.0.smithi197.stdout: "tunables": { 2021-03-30T05:17:06.328 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_local_tries": 0, 2021-03-30T05:17:06.328 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_local_fallback_tries": 0, 2021-03-30T05:17:06.328 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_total_tries": 50, 2021-03-30T05:17:06.328 INFO:tasks.workunit.client.0.smithi197.stdout: "chooseleaf_descend_once": 1, 2021-03-30T05:17:06.328 INFO:tasks.workunit.client.0.smithi197.stdout: "chooseleaf_vary_r": 1, 2021-03-30T05:17:06.329 INFO:tasks.workunit.client.0.smithi197.stdout: "chooseleaf_stable": 1, 2021-03-30T05:17:06.329 INFO:tasks.workunit.client.0.smithi197.stdout: "straw_calc_version": 1, 2021-03-30T05:17:06.329 INFO:tasks.workunit.client.0.smithi197.stdout: "allowed_bucket_algs": 54, 2021-03-30T05:17:06.329 INFO:tasks.workunit.client.0.smithi197.stdout: "profile": "jewel", 2021-03-30T05:17:06.329 INFO:tasks.workunit.client.0.smithi197.stdout: "optimal_tunables": 1, 2021-03-30T05:17:06.330 INFO:tasks.workunit.client.0.smithi197.stdout: "legacy_tunables": 0, 2021-03-30T05:17:06.330 INFO:tasks.workunit.client.0.smithi197.stdout: "minimum_required_version": "jewel", 2021-03-30T05:17:06.330 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables": 1, 2021-03-30T05:17:06.330 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables2": 1, 2021-03-30T05:17:06.330 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v2_rules": 0, 2021-03-30T05:17:06.331 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables3": 1, 2021-03-30T05:17:06.331 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v3_rules": 0, 2021-03-30T05:17:06.331 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v4_buckets": 1, 2021-03-30T05:17:06.331 INFO:tasks.workunit.client.0.smithi197.stdout: "require_feature_tunables5": 1, 2021-03-30T05:17:06.331 INFO:tasks.workunit.client.0.smithi197.stdout: "has_v5_rules": 0 2021-03-30T05:17:06.332 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.332 INFO:tasks.workunit.client.0.smithi197.stdout: "choose_args": {} 2021-03-30T05:17:06.332 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.332 INFO:tasks.workunit.client.0.smithi197.stdout: "fsmap": { 2021-03-30T05:17:06.332 INFO:tasks.workunit.client.0.smithi197.stdout: "epoch": 1, 2021-03-30T05:17:06.333 INFO:tasks.workunit.client.0.smithi197.stdout: "default_fscid": -1, 2021-03-30T05:17:06.333 INFO:tasks.workunit.client.0.smithi197.stdout: "compat": { 2021-03-30T05:17:06.333 INFO:tasks.workunit.client.0.smithi197.stdout: "compat": {}, 2021-03-30T05:17:06.333 INFO:tasks.workunit.client.0.smithi197.stdout: "ro_compat": {}, 2021-03-30T05:17:06.333 INFO:tasks.workunit.client.0.smithi197.stdout: "incompat": { 2021-03-30T05:17:06.334 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_1": "base v0.20", 2021-03-30T05:17:06.334 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_2": "client writeable ranges", 2021-03-30T05:17:06.334 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_3": "default file layouts on dirs", 2021-03-30T05:17:06.334 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_4": "dir inode in separate object", 2021-03-30T05:17:06.334 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_5": "mds uses versioned encoding", 2021-03-30T05:17:06.334 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_6": "dirfrag is stored in omap", 2021-03-30T05:17:06.335 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_8": "no anchor table", 2021-03-30T05:17:06.335 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_9": "file layout v2", 2021-03-30T05:17:06.335 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_10": "snaprealm v2" 2021-03-30T05:17:06.335 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.336 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.336 INFO:tasks.workunit.client.0.smithi197.stdout: "feature_flags": { 2021-03-30T05:17:06.336 INFO:tasks.workunit.client.0.smithi197.stdout: "enable_multiple": false, 2021-03-30T05:17:06.336 INFO:tasks.workunit.client.0.smithi197.stdout: "ever_enabled_multiple": false 2021-03-30T05:17:06.336 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.337 INFO:tasks.workunit.client.0.smithi197.stdout: "standbys": [], 2021-03-30T05:17:06.337 INFO:tasks.workunit.client.0.smithi197.stdout: "filesystems": [] 2021-03-30T05:17:06.337 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.337 INFO:tasks.workunit.client.0.smithi197.stdout: "mdsmap_first_committed": 1, 2021-03-30T05:17:06.337 INFO:tasks.workunit.client.0.smithi197.stdout: "mdsmap_last_committed": 1, 2021-03-30T05:17:06.338 INFO:tasks.workunit.client.0.smithi197.stdout: "auth": { 2021-03-30T05:17:06.338 INFO:tasks.workunit.client.0.smithi197.stdout: "first_committed": 1, 2021-03-30T05:17:06.338 INFO:tasks.workunit.client.0.smithi197.stdout: "last_committed": 3, 2021-03-30T05:17:06.338 INFO:tasks.workunit.client.0.smithi197.stdout: "num_secrets": 1 2021-03-30T05:17:06.338 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.339 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg": 4, 2021-03-30T05:17:06.339 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg_active": 4, 2021-03-30T05:17:06.339 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg_unknown": 0, 2021-03-30T05:17:06.339 INFO:tasks.workunit.client.0.smithi197.stdout: "num_osd": 1, 2021-03-30T05:17:06.339 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_sum": { 2021-03-30T05:17:06.340 INFO:tasks.workunit.client.0.smithi197.stdout: "stat_sum": { 2021-03-30T05:17:06.340 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes": 19, 2021-03-30T05:17:06.340 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects": 1, 2021-03-30T05:17:06.340 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_clones": 0, 2021-03-30T05:17:06.340 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_copies": 2, 2021-03-30T05:17:06.341 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing_on_primary": 0, 2021-03-30T05:17:06.341 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing": 0, 2021-03-30T05:17:06.341 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_degraded": 1, 2021-03-30T05:17:06.341 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_misplaced": 0, 2021-03-30T05:17:06.341 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_unfound": 0, 2021-03-30T05:17:06.342 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_dirty": 1, 2021-03-30T05:17:06.342 INFO:tasks.workunit.client.0.smithi197.stdout: "num_whiteouts": 0, 2021-03-30T05:17:06.342 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read": 0, 2021-03-30T05:17:06.342 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read_kb": 0, 2021-03-30T05:17:06.342 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write": 2, 2021-03-30T05:17:06.343 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write_kb": 2, 2021-03-30T05:17:06.343 INFO:tasks.workunit.client.0.smithi197.stdout: "num_scrub_errors": 0, 2021-03-30T05:17:06.343 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shallow_scrub_errors": 0, 2021-03-30T05:17:06.343 INFO:tasks.workunit.client.0.smithi197.stdout: "num_deep_scrub_errors": 0, 2021-03-30T05:17:06.343 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_recovered": 0, 2021-03-30T05:17:06.344 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_recovered": 0, 2021-03-30T05:17:06.344 INFO:tasks.workunit.client.0.smithi197.stdout: "num_keys_recovered": 0, 2021-03-30T05:17:06.344 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_omap": 0, 2021-03-30T05:17:06.344 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_hit_set_archive": 0, 2021-03-30T05:17:06.344 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_hit_set_archive": 0, 2021-03-30T05:17:06.345 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush": 0, 2021-03-30T05:17:06.345 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_kb": 0, 2021-03-30T05:17:06.345 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict": 0, 2021-03-30T05:17:06.345 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_kb": 0, 2021-03-30T05:17:06.345 INFO:tasks.workunit.client.0.smithi197.stdout: "num_promote": 0, 2021-03-30T05:17:06.346 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_high": 0, 2021-03-30T05:17:06.346 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_low": 0, 2021-03-30T05:17:06.346 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_some": 0, 2021-03-30T05:17:06.346 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_full": 0, 2021-03-30T05:17:06.346 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_pinned": 0, 2021-03-30T05:17:06.346 INFO:tasks.workunit.client.0.smithi197.stdout: "num_legacy_snapsets": 0, 2021-03-30T05:17:06.347 INFO:tasks.workunit.client.0.smithi197.stdout: "num_large_omap_objects": 0, 2021-03-30T05:17:06.347 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_manifest": 0, 2021-03-30T05:17:06.347 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_bytes": 0, 2021-03-30T05:17:06.347 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_keys": 0, 2021-03-30T05:17:06.348 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_repaired": 0 2021-03-30T05:17:06.348 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.348 INFO:tasks.workunit.client.0.smithi197.stdout: "store_stats": { 2021-03-30T05:17:06.348 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 0, 2021-03-30T05:17:06.348 INFO:tasks.workunit.client.0.smithi197.stdout: "available": 0, 2021-03-30T05:17:06.348 INFO:tasks.workunit.client.0.smithi197.stdout: "internally_reserved": 0, 2021-03-30T05:17:06.349 INFO:tasks.workunit.client.0.smithi197.stdout: "allocated": 0, 2021-03-30T05:17:06.349 INFO:tasks.workunit.client.0.smithi197.stdout: "data_stored": 0, 2021-03-30T05:17:06.349 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed": 0, 2021-03-30T05:17:06.349 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_allocated": 0, 2021-03-30T05:17:06.349 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_original": 0, 2021-03-30T05:17:06.350 INFO:tasks.workunit.client.0.smithi197.stdout: "omap_allocated": 0, 2021-03-30T05:17:06.350 INFO:tasks.workunit.client.0.smithi197.stdout: "internal_metadata": 0 2021-03-30T05:17:06.350 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.350 INFO:tasks.workunit.client.0.smithi197.stdout: "log_size": 2, 2021-03-30T05:17:06.350 INFO:tasks.workunit.client.0.smithi197.stdout: "ondisk_log_size": 2, 2021-03-30T05:17:06.351 INFO:tasks.workunit.client.0.smithi197.stdout: "up": 4, 2021-03-30T05:17:06.351 INFO:tasks.workunit.client.0.smithi197.stdout: "acting": 4, 2021-03-30T05:17:06.351 INFO:tasks.workunit.client.0.smithi197.stdout: "num_store_stats": 0 2021-03-30T05:17:06.351 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.351 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_sum": { 2021-03-30T05:17:06.352 INFO:tasks.workunit.client.0.smithi197.stdout: "up_from": 0, 2021-03-30T05:17:06.352 INFO:tasks.workunit.client.0.smithi197.stdout: "seq": 0, 2021-03-30T05:17:06.352 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pgs": 4, 2021-03-30T05:17:06.352 INFO:tasks.workunit.client.0.smithi197.stdout: "num_osds": 1, 2021-03-30T05:17:06.352 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_osds": 1, 2021-03-30T05:17:06.353 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_omap_osds": 1, 2021-03-30T05:17:06.353 INFO:tasks.workunit.client.0.smithi197.stdout: "kb": 104857600, 2021-03-30T05:17:06.353 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used": 1050368, 2021-03-30T05:17:06.353 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_data": 1728, 2021-03-30T05:17:06.353 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_omap": 0, 2021-03-30T05:17:06.354 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_meta": 1048576, 2021-03-30T05:17:06.354 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_avail": 103807232, 2021-03-30T05:17:06.354 INFO:tasks.workunit.client.0.smithi197.stdout: "statfs": { 2021-03-30T05:17:06.354 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 107374182400, 2021-03-30T05:17:06.354 INFO:tasks.workunit.client.0.smithi197.stdout: "available": 106298605568, 2021-03-30T05:17:06.355 INFO:tasks.workunit.client.0.smithi197.stdout: "internally_reserved": 1073741824, 2021-03-30T05:17:06.355 INFO:tasks.workunit.client.0.smithi197.stdout: "allocated": 1769472, 2021-03-30T05:17:06.355 INFO:tasks.workunit.client.0.smithi197.stdout: "data_stored": 22750, 2021-03-30T05:17:06.355 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed": 0, 2021-03-30T05:17:06.356 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_allocated": 0, 2021-03-30T05:17:06.356 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_original": 0, 2021-03-30T05:17:06.356 INFO:tasks.workunit.client.0.smithi197.stdout: "omap_allocated": 0, 2021-03-30T05:17:06.356 INFO:tasks.workunit.client.0.smithi197.stdout: "internal_metadata": 1073741824 2021-03-30T05:17:06.356 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.357 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_peers": [], 2021-03-30T05:17:06.357 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_trim_queue_len": 0, 2021-03-30T05:17:06.357 INFO:tasks.workunit.client.0.smithi197.stdout: "num_snap_trimming": 0, 2021-03-30T05:17:06.357 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shards_repaired": 0, 2021-03-30T05:17:06.357 INFO:tasks.workunit.client.0.smithi197.stdout: "op_queue_age_hist": { 2021-03-30T05:17:06.357 INFO:tasks.workunit.client.0.smithi197.stdout: "histogram": [], 2021-03-30T05:17:06.358 INFO:tasks.workunit.client.0.smithi197.stdout: "upper_bound": 1 2021-03-30T05:17:06.358 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.358 INFO:tasks.workunit.client.0.smithi197.stdout: "perf_stat": { 2021-03-30T05:17:06.358 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ms": 0, 2021-03-30T05:17:06.358 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ms": 0, 2021-03-30T05:17:06.359 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ns": 0, 2021-03-30T05:17:06.359 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ns": 0 2021-03-30T05:17:06.359 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.359 INFO:tasks.workunit.client.0.smithi197.stdout: "alerts": [], 2021-03-30T05:17:06.359 INFO:tasks.workunit.client.0.smithi197.stdout: "network_ping_times": [] 2021-03-30T05:17:06.360 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.360 INFO:tasks.workunit.client.0.smithi197.stdout: "osd_sum_by_class": { 2021-03-30T05:17:06.360 INFO:tasks.workunit.client.0.smithi197.stdout: "hdd": { 2021-03-30T05:17:06.360 INFO:tasks.workunit.client.0.smithi197.stdout: "up_from": 0, 2021-03-30T05:17:06.360 INFO:tasks.workunit.client.0.smithi197.stdout: "seq": 0, 2021-03-30T05:17:06.361 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pgs": 4, 2021-03-30T05:17:06.361 INFO:tasks.workunit.client.0.smithi197.stdout: "num_osds": 1, 2021-03-30T05:17:06.361 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_osds": 1, 2021-03-30T05:17:06.361 INFO:tasks.workunit.client.0.smithi197.stdout: "num_per_pool_omap_osds": 1, 2021-03-30T05:17:06.361 INFO:tasks.workunit.client.0.smithi197.stdout: "kb": 104857600, 2021-03-30T05:17:06.362 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used": 1050368, 2021-03-30T05:17:06.362 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_data": 1728, 2021-03-30T05:17:06.362 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_omap": 0, 2021-03-30T05:17:06.362 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_used_meta": 1048576, 2021-03-30T05:17:06.362 INFO:tasks.workunit.client.0.smithi197.stdout: "kb_avail": 103807232, 2021-03-30T05:17:06.363 INFO:tasks.workunit.client.0.smithi197.stdout: "statfs": { 2021-03-30T05:17:06.363 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 107374182400, 2021-03-30T05:17:06.363 INFO:tasks.workunit.client.0.smithi197.stdout: "available": 106298605568, 2021-03-30T05:17:06.363 INFO:tasks.workunit.client.0.smithi197.stdout: "internally_reserved": 1073741824, 2021-03-30T05:17:06.363 INFO:tasks.workunit.client.0.smithi197.stdout: "allocated": 1769472, 2021-03-30T05:17:06.364 INFO:tasks.workunit.client.0.smithi197.stdout: "data_stored": 22750, 2021-03-30T05:17:06.364 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed": 0, 2021-03-30T05:17:06.364 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_allocated": 0, 2021-03-30T05:17:06.364 INFO:tasks.workunit.client.0.smithi197.stdout: "data_compressed_original": 0, 2021-03-30T05:17:06.364 INFO:tasks.workunit.client.0.smithi197.stdout: "omap_allocated": 0, 2021-03-30T05:17:06.365 INFO:tasks.workunit.client.0.smithi197.stdout: "internal_metadata": 1073741824 2021-03-30T05:17:06.365 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.365 INFO:tasks.workunit.client.0.smithi197.stdout: "hb_peers": [], 2021-03-30T05:17:06.365 INFO:tasks.workunit.client.0.smithi197.stdout: "snap_trim_queue_len": 0, 2021-03-30T05:17:06.365 INFO:tasks.workunit.client.0.smithi197.stdout: "num_snap_trimming": 0, 2021-03-30T05:17:06.365 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shards_repaired": 0, 2021-03-30T05:17:06.366 INFO:tasks.workunit.client.0.smithi197.stdout: "op_queue_age_hist": { 2021-03-30T05:17:06.366 INFO:tasks.workunit.client.0.smithi197.stdout: "histogram": [], 2021-03-30T05:17:06.366 INFO:tasks.workunit.client.0.smithi197.stdout: "upper_bound": 1 2021-03-30T05:17:06.366 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.366 INFO:tasks.workunit.client.0.smithi197.stdout: "perf_stat": { 2021-03-30T05:17:06.367 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ms": 0, 2021-03-30T05:17:06.367 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ms": 0, 2021-03-30T05:17:06.367 INFO:tasks.workunit.client.0.smithi197.stdout: "commit_latency_ns": 0, 2021-03-30T05:17:06.367 INFO:tasks.workunit.client.0.smithi197.stdout: "apply_latency_ns": 0 2021-03-30T05:17:06.368 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.368 INFO:tasks.workunit.client.0.smithi197.stdout: "alerts": [], 2021-03-30T05:17:06.368 INFO:tasks.workunit.client.0.smithi197.stdout: "network_ping_times": [] 2021-03-30T05:17:06.368 INFO:tasks.workunit.client.0.smithi197.stdout: } 2021-03-30T05:17:06.368 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.369 INFO:tasks.workunit.client.0.smithi197.stdout: "pool_stats": [ 2021-03-30T05:17:06.369 INFO:tasks.workunit.client.0.smithi197.stdout: { 2021-03-30T05:17:06.369 INFO:tasks.workunit.client.0.smithi197.stdout: "poolid": 1, 2021-03-30T05:17:06.369 INFO:tasks.workunit.client.0.smithi197.stdout: "num_pg": 4, 2021-03-30T05:17:06.369 INFO:tasks.workunit.client.0.smithi197.stdout: "stat_sum": { 2021-03-30T05:17:06.370 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes": 19, 2021-03-30T05:17:06.370 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects": 1, 2021-03-30T05:17:06.370 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_clones": 0, 2021-03-30T05:17:06.370 INFO:tasks.workunit.client.0.smithi197.stdout: "num_object_copies": 2, 2021-03-30T05:17:06.370 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing_on_primary": 0, 2021-03-30T05:17:06.370 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_missing": 0, 2021-03-30T05:17:06.371 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_degraded": 1, 2021-03-30T05:17:06.371 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_misplaced": 0, 2021-03-30T05:17:06.371 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_unfound": 0, 2021-03-30T05:17:06.371 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_dirty": 1, 2021-03-30T05:17:06.372 INFO:tasks.workunit.client.0.smithi197.stdout: "num_whiteouts": 0, 2021-03-30T05:17:06.372 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read": 0, 2021-03-30T05:17:06.372 INFO:tasks.workunit.client.0.smithi197.stdout: "num_read_kb": 0, 2021-03-30T05:17:06.372 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write": 2, 2021-03-30T05:17:06.372 INFO:tasks.workunit.client.0.smithi197.stdout: "num_write_kb": 2, 2021-03-30T05:17:06.373 INFO:tasks.workunit.client.0.smithi197.stdout: "num_scrub_errors": 0, 2021-03-30T05:17:06.373 INFO:tasks.workunit.client.0.smithi197.stdout: "num_shallow_scrub_errors": 0, 2021-03-30T05:17:06.373 INFO:tasks.workunit.client.0.smithi197.stdout: "num_deep_scrub_errors": 0, 2021-03-30T05:17:06.373 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_recovered": 0, 2021-03-30T05:17:06.373 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_recovered": 0, 2021-03-30T05:17:06.373 INFO:tasks.workunit.client.0.smithi197.stdout: "num_keys_recovered": 0, 2021-03-30T05:17:06.374 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_omap": 0, 2021-03-30T05:17:06.374 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_hit_set_archive": 0, 2021-03-30T05:17:06.374 INFO:tasks.workunit.client.0.smithi197.stdout: "num_bytes_hit_set_archive": 0, 2021-03-30T05:17:06.374 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush": 0, 2021-03-30T05:17:06.374 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_kb": 0, 2021-03-30T05:17:06.375 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict": 0, 2021-03-30T05:17:06.375 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_kb": 0, 2021-03-30T05:17:06.375 INFO:tasks.workunit.client.0.smithi197.stdout: "num_promote": 0, 2021-03-30T05:17:06.375 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_high": 0, 2021-03-30T05:17:06.376 INFO:tasks.workunit.client.0.smithi197.stdout: "num_flush_mode_low": 0, 2021-03-30T05:17:06.376 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_some": 0, 2021-03-30T05:17:06.376 INFO:tasks.workunit.client.0.smithi197.stdout: "num_evict_mode_full": 0, 2021-03-30T05:17:06.376 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_pinned": 0, 2021-03-30T05:17:06.376 INFO:tasks.workunit.client.0.smithi197.stdout: "num_legacy_snapsets": 0, 2021-03-30T05:17:06.377 INFO:tasks.workunit.client.0.smithi197.stdout: "num_large_omap_objects": 0, 2021-03-30T05:17:06.377 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_manifest": 0, 2021-03-30T05:17:06.377 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_bytes": 0, 2021-03-30T05:17:06.377 INFO:tasks.workunit.client.0.smithi197.stdout: "num_omap_keys": 0, 2021-03-30T05:17:06.377 INFO:tasks.workunit.client.0.smithi197.stdout: "num_objects_repaired": 0 2021-03-30T05:17:06.377 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2021-03-30T05:17:06.378 INFO:tasks.workunit.client.0.smithi197.stdout: "store_stats": { 2021-03-30T05:17:06.378 INFO:tasks.workunit.client.0.smithi197.stdout: "total": 0, 2021-03-30T05:17:06.378 INFO:tasks.workunit.cl