2023-01-25T04:35:51.259 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T04:35:51.261 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} --archive /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136767 --name yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136767/orig.config.yaml 2023-01-25T04:35:51.284 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T04:35:51.342 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136767 branch: wip-yuri2-testing-2023-01-23-0928 description: rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} email: yweinstein@radhat.com first_in_suite: false job_id: '7136767' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri2-testing-2023-01-23-0928 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 61996d73ab738798e4ee0055c86457f5c459da4a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 61996d73ab738798e4ee0055c86457f5c459da4a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri2-testing-2023-01-23-0928 sha1: 61996d73ab738798e4ee0055c86457f5c459da4a owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: 61996d73ab738798e4ee0055c86457f5c459da4a sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri2-testing-2023-01-23-0928 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 61996d73ab738798e4ee0055c86457f5c459da4a targets: smithi082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTP1GbaA4PMrkqsKy1OzilN9qZgGmaYU6QVA2dfkIguixNODBWI2NnekvPqVyC4ZRTYR6efZnLrlEg7cI757Shs7sKNl2Ud18yD5F1Zadl/ms56jrQFK5DO02OZXQ11fzCHzFHhC4lu2SSNlSvB2PPZXiYc8r6yF1uzPUFsQRe0Us0OagufI3DheIuTQY2zVKYhXnJmY/8JcaiDx5MOXwrIMB0+OedmhB03sv233SDc3ns4ZC5jxJPIcYsY8940xh76xaXhL3vY1Qibt2ZcRxxvU5MjBZrzcI26/iXoWv8vyK2oc3TJwreyJCt8nZGJt92qSOcvQ/DerZ4fODdlR/JmUrrTRTMklKElqcesBNNbDsNLVIygAxBYWl6bUIg4ZmSGpDhMgxlOuf0mjBsIM0aAKzbgJcrvQWnGYM8ev9VCWy6D4LVmYoZ5Iq8SkgkU8G28DtVsS8i7IqeISekrzcJh+lmBcxu7cpTKKqZbApOBcf65j5FTlQVxijkkoWHCLE= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - crush teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:22:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T04:35:51.342 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa; will attempt to use it 2023-01-25T04:35:51.343 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa/tasks 2023-01-25T04:35:51.343 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T04:35:51.346 INFO:teuthology.task.internal:Checking packages... 2023-01-25T04:35:51.373 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '61996d73ab738798e4ee0055c86457f5c459da4a' 2023-01-25T04:35:51.374 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T04:35:51.374 INFO:teuthology.packaging:ref: None 2023-01-25T04:35:51.375 INFO:teuthology.packaging:tag: None 2023-01-25T04:35:51.375 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-01-23-0928 2023-01-25T04:35:51.375 INFO:teuthology.packaging:sha1: 61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T04:35:51.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-01-23-0928 2023-01-25T04:35:51.676 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1963.g61996d73 2023-01-25T04:35:51.676 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T04:35:51.683 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T04:35:51.683 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T04:35:51.719 INFO:teuthology.task.internal:Saving configuration 2023-01-25T04:35:51.729 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T04:35:51.752 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T04:35:51.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136767', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 04:30:37.874749', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD443UEWv97/WhDw1jOx3IOB0wGG7oHtinIyS/HZij5NE7zGRdFTxiXirNqZPUajBcyH6DATdyvBj7jjeU4Vsfg='} 2023-01-25T04:35:51.776 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T04:35:51.784 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-01-25T04:35:51.784 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T04:35:51.850 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd962c9c5e0>, signals=[15]) 2023-01-25T04:35:51.851 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T04:35:51.857 INFO:teuthology.task.internal:Opening connections... 2023-01-25T04:35:51.857 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2023-01-25T04:35:51.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:35:51.931 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T04:35:51.941 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-01-25T04:35:52.009 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-01-25T04:35:52.009 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-01-25T04:35:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2023-01-25T04:35:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8" 2023-01-25T04:35:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2023-01-25T04:35:52.069 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2023-01-25T04:35:52.070 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2023-01-25T04:35:52.070 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-01-25T04:35:52.070 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T04:35:52.070 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-01-25T04:35:52.070 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T04:35:52.071 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2023-01-25T04:35:52.071 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T04:35:52.071 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T04:35:52.071 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T04:35:52.072 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-01-25T04:35:52.087 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T04:35:52.095 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T04:35:52.127 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T04:35:52.127 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2023-01-25T04:35:52.147 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T04:35:52.160 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T04:35:52.161 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2023-01-25T04:35:52.273 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T04:35:52.303 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T04:35:52.319 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T04:35:52.320 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T04:35:52.320 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T04:35:52.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:35:52.340 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-01-25T04:35:52.399 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-408.el8.x86_64 2023-01-25T04:35:52.399 INFO:teuthology.task.kernel:Running kernel on smithi082: 4.18.0-408.el8.x86_64 2023-01-25T04:35:52.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2023-01-25T04:35:55.853 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - AppStream 40 MB/s | 27 MB 00:00 2023-01-25T04:36:01.527 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - BaseOS 38 MB/s | 27 MB 00:00 2023-01-25T04:36:05.826 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - Extras 116 kB/s | 18 kB 00:00 2023-01-25T04:36:06.228 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - PowerTools 21 MB/s | 5.6 MB 00:00 2023-01-25T04:36:07.611 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-01-25T04:36:08.786 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:01 2023-01-25T04:36:12.269 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 94 kB/s | 24 kB 00:00 2023-01-25T04:36:15.383 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T04:36:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T04:36:15.561 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:36:15.562 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:36:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:36:15.562 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:36:15.563 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:36:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T04:36:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T04:36:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T04:36:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:36:15.564 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:36:15.564 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:36:15.564 INFO:teuthology.orchestra.run.smithi082.stdout:Install 3 Packages 2023-01-25T04:36:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:36:15.565 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 85 M 2023-01-25T04:36:15.565 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 94 M 2023-01-25T04:36:15.565 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:36:15.936 INFO:teuthology.orchestra.run.smithi082.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 25 MB/s | 9.2 MB 00:00 2023-01-25T04:36:16.920 INFO:teuthology.orchestra.run.smithi082.stdout:(2/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 25 MB/s | 34 MB 00:01 2023-01-25T04:36:17.304 INFO:teuthology.orchestra.run.smithi082.stdout:(3/3): kernel-core-4.18.0-448.el8.x86_64.rpm 24 MB/s | 41 MB 00:01 2023-01-25T04:36:17.306 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:36:17.307 INFO:teuthology.orchestra.run.smithi082.stdout:Total 48 MB/s | 85 MB 00:01 2023-01-25T04:36:17.950 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:36:18.340 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:36:18.340 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:36:20.373 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:36:20.409 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:36:23.116 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:36:23.686 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:36:27.566 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:36:28.052 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:36:31.380 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:36:31.634 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:36:53.293 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:36:53.319 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:36:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:36:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:36:53.718 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:36:54.293 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:36:54.293 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:36:54.294 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:36:54.294 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T04:36:54.294 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T04:36:54.294 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:36:54.295 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:36:54.409 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel --last | head -n 1 2023-01-25T04:36:54.604 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 04:36:31 AM UTC 2023-01-25T04:36:54.606 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T04:36:54.606 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T04:36:54.606 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T04:36:54.607 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T04:36:54.607 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-25T04:36:54.607 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T04:36:54.607 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel --last | head -n 1 2023-01-25T04:36:54.800 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 04:36:31 AM UTC 2023-01-25T04:36:54.802 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T04:36:54.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2023-01-25T04:36:54.835 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2023-01-25T04:36:54.836 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2023-01-25T04:36:54.836 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.02 2023-01-25T04:36:54.836 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 129.el8 2023-01-25T04:36:54.836 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2023-01-25T04:36:54.837 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T04:36:54.837 INFO:teuthology.orchestra.run.smithi082.stdout:Group : System Environment/Base 2023-01-25T04:36:54.837 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 9265586 2023-01-25T04:36:54.837 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2023-01-25T04:36:54.837 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T04:36:54.838 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T04:36:54.838 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T04:36:54.838 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T04:36:54.838 INFO:teuthology.orchestra.run.smithi082.stdout:Relocations : (not relocatable) 2023-01-25T04:36:54.838 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : CentOS BuildSystem 2023-01-25T04:36:54.839 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2023-01-25T04:36:54.839 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T04:36:54.839 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2023-01-25T04:36:54.839 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2023-01-25T04:36:54.839 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:36:54.840 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T04:36:54.840 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T04:36:54.840 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T04:36:54.840 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2023-01-25T04:36:54.840 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:36:54.841 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T04:36:54.841 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T04:36:54.842 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 4.18.0-448.el8.x86_64 2023-01-25T04:36:54.842 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T04:36:56.287 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-01-25T04:36:57.994 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-01-25T04:36:57.996 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-01-25T04:36:58.027 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.v5zPbjZGeD 2023-01-25T04:36:58.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.v5zPbjZGeD 2023-01-25T04:36:58.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.v5zPbjZGeD 2023-01-25T04:36:58.259 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.v5zPbjZGeD is 6KB 2023-01-25T04:36:58.308 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.v5zPbjZGeD 2023-01-25T04:36:58.325 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T04:36:58.395 INFO:teuthology.orchestra.run.smithi082.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T04:36:58.395 INFO:teuthology.orchestra.run.smithi082.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T04:36:58.395 INFO:teuthology.orchestra.run.smithi082.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T04:36:58.395 INFO:teuthology.orchestra.run.smithi082.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T04:36:58.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T04:36:58.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2023-01-25T04:37:28.581 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-25T04:37:28.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-01-25T04:37:28.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:37:46.988 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-01-25T04:38:17.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-01-25T04:38:17.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:38:35.368 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-01-25T04:39:05.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-01-25T04:39:05.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:39:05.812 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-01-25T04:39:06.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-01-25T04:39:06.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-448.el8.x86_64"... 2023-01-25T04:39:06.091 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-01-25T04:39:06.149 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-448.el8.x86_64 2023-01-25T04:39:06.150 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T04:39:06.150 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T04:39:06.150 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T04:39:07.151 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T04:39:07.152 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T04:39:07.249 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2023-01-25T04:39:07.263 DEBUG:teuthology.parallel:result is None 2023-01-25T04:39:07.264 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T04:39:07.271 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T04:39:07.272 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T04:39:07.291 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T04:39:07.305 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T04:39:07.350 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T04:39:07.351 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T04:39:07.385 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T04:39:07.400 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T04:39:07.400 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T04:39:07.458 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:39:07.468 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:39:07.469 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T04:39:07.476 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T04:39:07.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T04:39:07.537 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T04:39:07.545 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T04:39:07.546 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T04:39:07.595 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:39:07.680 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:39:07.734 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:39:07.818 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:39:07.861 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-01-25T04:39:07.861 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T04:39:07.928 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2023-01-25T04:39:08.016 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T04:39:08.368 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T04:39:08.377 INFO:teuthology.task.internal:Starting timer... 2023-01-25T04:39:08.377 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T04:39:08.412 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T04:39:08.463 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-25T04:39:08.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2023-01-25T04:39:08.562 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2023-01-25T04:39:08.564 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T04:39:08.564 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2023-01-25T04:39:08.588 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2023-01-25T04:39:08.588 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive'} 2023-01-25T04:39:08.589 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T04:39:08.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:39:08.657 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T04:39:08.657 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2023-01-25T04:39:08.733 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T04:39:08.743 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-01-25T04:39:08.748 INFO:teuthology.repo_utils:Fetching main from origin 2023-01-25T04:39:08.854 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T04:39:08.870 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T04:39:08.872 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T04:45:30.467 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com')] 2023-01-25T04:45:30.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-01-25T04:45:30.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:45:30.540 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-01-25T04:45:30.611 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T04:45:30.621 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T04:45:30.622 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T04:45:30.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T04:45:30.684 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T04:45:30.697 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T04:45:30.768 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2023-01-25T04:45:30.780 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2023-01-25T04:45:30.794 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T04:45:30.808 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T04:45:30.881 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2023-01-25T04:45:30.884 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T04:45:30.884 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2023-01-25T04:45:30.885 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:45:30.885 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:45:30.885 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:45:30.885 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:45:30.886 INFO:teuthology.run_tasks:Running task install... 2023-01-25T04:45:30.895 DEBUG:teuthology.task.install:project ceph 2023-01-25T04:45:30.895 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}} 2023-01-25T04:45:30.895 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'} 2023-01-25T04:45:30.896 INFO:teuthology.task.install:Using flavor: default 2023-01-25T04:45:30.901 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T04:45:30.902 INFO:teuthology.task.install:extra packages: [] 2023-01-25T04:45:30.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo lsb_release -is 2023-01-25T04:45:30.964 INFO:teuthology.orchestra.run.smithi082.stdout:CentOSStream 2023-01-25T04:45:30.965 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:45:30.965 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'tag': None, 'wait_for_package': False} 2023-01-25T04:45:30.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo lsb_release -is 2023-01-25T04:45:31.041 INFO:teuthology.orchestra.run.smithi082.stdout:CentOSStream 2023-01-25T04:45:31.042 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:45:31.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T04:45:31.195 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/ 2023-01-25T04:45:31.195 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1963.g61996d73 2023-01-25T04:45:31.315 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T04:45:31.316 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-01-25T04:45:31.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T04:45:31.343 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T04:45:31.343 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/61996d73ab738798e4ee0055c86457f5c459da4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T04:45:31.411 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T04:45:31.488 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T04:45:31.554 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2023-01-25T04:45:31.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2023-01-25T04:45:31.803 INFO:teuthology.orchestra.run.smithi082.stdout:61 files removed 2023-01-25T04:45:31.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw 2023-01-25T04:45:32.508 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 293 kB/s | 80 kB 00:00 2023-01-25T04:45:32.800 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 37 kB/s | 9.4 kB 00:00 2023-01-25T04:45:33.085 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 5.8 kB/s | 1.5 kB 00:00 2023-01-25T04:45:33.779 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - AppStream 41 MB/s | 27 MB 00:00 2023-01-25T04:45:39.429 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - BaseOS 43 MB/s | 27 MB 00:00 2023-01-25T04:45:43.719 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - Extras 153 kB/s | 18 kB 00:00 2023-01-25T04:45:44.171 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-8 - PowerTools 18 MB/s | 5.6 MB 00:00 2023-01-25T04:45:45.404 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-01-25T04:45:46.787 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-25T04:45:50.088 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 442 kB/s | 24 kB 00:00 2023-01-25T04:45:53.592 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:45:53.594 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:45:53.595 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:45:53.595 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:45:53.595 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:45:53.595 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 13 M 2023-01-25T04:45:53.596 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2023-01-25T04:45:53.596 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T04:45:53.596 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T04:45:53.596 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:45:53.596 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:18.0.0-1963.g61996d73.el8 ceph 5.2 M 2023-01-25T04:45:53.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 M 2023-01-25T04:45:53.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 k 2023-01-25T04:45:53.597 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T04:45:53.597 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 767 k 2023-01-25T04:45:53.597 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T04:45:53.598 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T04:45:53.598 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 474 k 2023-01-25T04:45:53.598 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T04:45:53.598 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.5 M 2023-01-25T04:45:53.598 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T04:45:53.599 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T04:45:53.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse 2023-01-25T04:45:53.599 INFO:teuthology.orchestra.run.smithi082.stdout: x86_64 2:18.0.0-1963.g61996d73.el8 ceph 45 k 2023-01-25T04:45:53.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 115 k 2023-01-25T04:45:53.599 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:18.0.0-1963.g61996d73.el8 ceph 190 k 2023-01-25T04:45:53.600 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T04:45:53.600 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:18.0.0-1963.g61996d73.el8 ceph 371 k 2023-01-25T04:45:53.600 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 365 k 2023-01-25T04:45:53.600 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 107 k 2023-01-25T04:45:53.601 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T04:45:53.601 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:45:53.601 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:45:53.601 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:45:53.601 INFO:teuthology.orchestra.run.smithi082.stdout:Install 21 Packages 2023-01-25T04:45:53.602 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 2 Packages 2023-01-25T04:45:53.602 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:45:53.602 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 62 M 2023-01-25T04:45:53.603 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:45:54.597 INFO:teuthology.orchestra.run.smithi082.stdout:(1/23): ceph-base-18.0.0-1963.g61996d73.el8.x86 5.2 MB/s | 5.2 MB 00:00 2023-01-25T04:45:54.731 INFO:teuthology.orchestra.run.smithi082.stdout:(2/23): ceph-radosgw-18.0.0-1963.g61996d73.el8. 12 MB/s | 13 MB 00:01 2023-01-25T04:45:54.756 INFO:teuthology.orchestra.run.smithi082.stdout:(3/23): ceph-selinux-18.0.0-1963.g61996d73.el8. 154 kB/s | 24 kB 00:00 2023-01-25T04:45:54.814 INFO:teuthology.orchestra.run.smithi082.stdout:(4/23): libcephfs2-18.0.0-1963.g61996d73.el8.x8 9.0 MB/s | 767 kB 00:00 2023-01-25T04:45:54.839 INFO:teuthology.orchestra.run.smithi082.stdout:(5/23): libradosstriper1-18.0.0-1963.g61996d73. 5.5 MB/s | 474 kB 00:00 2023-01-25T04:45:54.932 INFO:teuthology.orchestra.run.smithi082.stdout:(6/23): python3-ceph-argparse-18.0.0-1963.g6199 486 kB/s | 45 kB 00:00 2023-01-25T04:45:55.050 INFO:teuthology.orchestra.run.smithi082.stdout:(7/23): python3-ceph-common-18.0.0-1963.g61996d 971 kB/s | 115 kB 00:00 2023-01-25T04:45:55.166 INFO:teuthology.orchestra.run.smithi082.stdout:(8/23): python3-cephfs-18.0.0-1963.g61996d73.el 1.6 MB/s | 190 kB 00:00 2023-01-25T04:45:55.241 INFO:teuthology.orchestra.run.smithi082.stdout:(9/23): python3-rados-18.0.0-1963.g61996d73.el8 4.8 MB/s | 371 kB 00:00 2023-01-25T04:45:55.316 INFO:teuthology.orchestra.run.smithi082.stdout:(10/23): librgw2-18.0.0-1963.g61996d73.el8.x86_ 13 MB/s | 6.5 MB 00:00 2023-01-25T04:45:55.341 INFO:teuthology.orchestra.run.smithi082.stdout:(11/23): python3-rbd-18.0.0-1963.g61996d73.el8. 3.6 MB/s | 365 kB 00:00 2023-01-25T04:45:55.366 INFO:teuthology.orchestra.run.smithi082.stdout:(12/23): python3-rgw-18.0.0-1963.g61996d73.el8. 2.1 MB/s | 107 kB 00:00 2023-01-25T04:45:55.425 INFO:teuthology.orchestra.run.smithi082.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-01-25T04:45:55.450 INFO:teuthology.orchestra.run.smithi082.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.2 MB/s | 259 kB 00:00 2023-01-25T04:45:55.467 INFO:teuthology.orchestra.run.smithi082.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 1.0 MB/s | 44 kB 00:00 2023-01-25T04:45:55.485 INFO:teuthology.orchestra.run.smithi082.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-01-25T04:45:55.618 INFO:teuthology.orchestra.run.smithi082.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 442 kB/s | 59 kB 00:00 2023-01-25T04:45:55.677 INFO:teuthology.orchestra.run.smithi082.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-01-25T04:45:55.702 INFO:teuthology.orchestra.run.smithi082.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 898 kB/s | 75 kB 00:00 2023-01-25T04:45:55.911 INFO:teuthology.orchestra.run.smithi082.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-01-25T04:45:56.169 INFO:teuthology.orchestra.run.smithi082.stdout:(21/23): ceph-common-18.0.0-1963.g61996d73.el8. 9.5 MB/s | 24 MB 00:02 2023-01-25T04:45:56.236 INFO:teuthology.orchestra.run.smithi082.stdout:(22/23): librados2-18.0.0-1963.g61996d73.el8.x8 6.8 MB/s | 3.6 MB 00:00 2023-01-25T04:45:56.295 INFO:teuthology.orchestra.run.smithi082.stdout:(23/23): librbd1-18.0.0-1963.g61996d73.el8.x86_ 9.3 MB/s | 3.6 MB 00:00 2023-01-25T04:45:56.298 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:45:56.299 INFO:teuthology.orchestra.run.smithi082.stdout:Total 23 MB/s | 62 MB 00:02 2023-01-25T04:45:56.338 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:45:56.382 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:45:56.382 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:45:57.036 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:45:57.039 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:45:58.293 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:45:58.490 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T04:45:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T04:45:58.892 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T04:45:59.301 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T04:45:59.508 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T04:45:59.611 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T04:45:59.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T04:46:00.058 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T04:46:00.454 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T04:46:00.617 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T04:46:00.683 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T04:46:00.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T04:46:01.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:46:01.112 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:46:01.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 10/25 2023-01-25T04:46:01.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T04:46:01.700 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T04:46:01.858 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T04:46:01.925 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T04:46:02.159 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T04:46:02.960 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T04:46:03.183 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T04:46:03.255 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T04:46:03.458 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T04:46:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T04:46:03.825 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 19/25 2023-01-25T04:46:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T04:46:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T04:46:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T04:46:08.813 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T04:46:08.891 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T04:46:09.065 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T04:46:28.095 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T04:46:28.096 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2023-01-25T04:46:28.096 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2023-01-25T04:46:28.096 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-01-25T04:46:28.096 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2023-01-25T04:46:28.097 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2023-01-25T04:46:28.097 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2023-01-25T04:46:28.097 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2023-01-25T04:46:28.097 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2023-01-25T04:46:28.097 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2023-01-25T04:46:28.098 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:29.525 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T04:46:29.546 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T04:46:29.546 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:46:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:46:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:46:30.505 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:46:30.505 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 1/25 2023-01-25T04:46:30.506 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2/25 2023-01-25T04:46:30.506 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T04:46:30.506 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T04:46:30.506 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T04:46:30.506 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 6/25 2023-01-25T04:46:30.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T04:46:30.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 8/25 2023-01-25T04:46:30.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 9/25 2023-01-25T04:46:30.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 10/25 2023-01-25T04:46:30.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T04:46:30.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T04:46:30.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 13/25 2023-01-25T04:46:30.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T04:46:30.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T04:46:30.509 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T04:46:30.509 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T04:46:30.509 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T04:46:30.509 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T04:46:30.509 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T04:46:30.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T04:46:30.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T04:46:30.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T04:46:30.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 24/25 2023-01-25T04:46:31.337 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:46:31.337 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:31.337 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2023-01-25T04:46:31.338 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.338 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.338 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:46:31.338 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.338 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.339 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.339 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.339 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T04:46:31.339 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.339 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T04:46:31.340 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T04:46:31.340 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.340 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T04:46:31.340 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.340 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T04:46:31.341 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T04:46:31.341 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.341 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.341 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.341 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T04:46:31.341 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.342 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.342 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:31.342 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T04:46:31.343 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:31.343 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:46:31.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-test 2023-01-25T04:46:32.399 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:42 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:46:33.543 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:46:33.544 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:46:33.544 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:46:33.544 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:46:33.544 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:46:33.545 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:18.0.0-1963.g61996d73.el8 ceph 47 M 2023-01-25T04:46:33.545 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:46:33.545 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T04:46:33.545 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:18.0.0-1963.g61996d73.el8 ceph 137 k 2023-01-25T04:46:33.545 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T04:46:33.546 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T04:46:33.546 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T04:46:33.546 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:33.546 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:46:33.546 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:46:33.547 INFO:teuthology.orchestra.run.smithi082.stdout:Install 6 Packages 2023-01-25T04:46:33.547 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:33.547 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 48 M 2023-01-25T04:46:33.548 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 218 M 2023-01-25T04:46:33.548 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:46:33.624 INFO:teuthology.orchestra.run.smithi082.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-01-25T04:46:33.649 INFO:teuthology.orchestra.run.smithi082.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.6 MB/s | 187 kB 00:00 2023-01-25T04:46:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-01-25T04:46:33.708 INFO:teuthology.orchestra.run.smithi082.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-01-25T04:46:33.766 INFO:teuthology.orchestra.run.smithi082.stdout:(5/6): libcephsqlite-18.0.0-1963.g61996d73.el8. 625 kB/s | 137 kB 00:00 2023-01-25T04:46:35.841 INFO:teuthology.orchestra.run.smithi082.stdout:(6/6): ceph-test-18.0.0-1963.g61996d73.el8.x86_ 21 MB/s | 47 MB 00:02 2023-01-25T04:46:35.844 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:35.844 INFO:teuthology.orchestra.run.smithi082.stdout:Total 21 MB/s | 48 MB 00:02 2023-01-25T04:46:35.887 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:46:35.908 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:46:35.908 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:46:36.205 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:46:36.209 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:46:36.675 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:46:36.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T04:46:37.119 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T04:46:37.283 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T04:46:37.367 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T04:46:37.576 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T04:46:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T04:46:42.357 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T04:46:42.679 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T04:46:42.957 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T04:46:42.958 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 1/6 2023-01-25T04:46:42.958 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2/6 2023-01-25T04:46:42.958 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T04:46:42.958 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T04:46:42.958 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T04:46:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T04:46:43.481 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:43.482 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:46:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-6.el8.x86_64 2023-01-25T04:46:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:46:43.482 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T04:46:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T04:46:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T04:46:43.483 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:43.483 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:46:43.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph 2023-01-25T04:46:44.436 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:46:45.573 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:46:45.576 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2023-01-25T04:46:45.577 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:46:45.577 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2023-01-25T04:46:45.578 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:46:45.578 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.4 k 2023-01-25T04:46:45.578 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:46:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:18.0.0-1963.g61996d73.el8 ceph 2.3 M 2023-01-25T04:46:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:18.0.0-1963.g61996d73.el8 ceph 1.5 M 2023-01-25T04:46:45.579 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 236 k 2023-01-25T04:46:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.9 M 2023-01-25T04:46:45.580 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 17 M 2023-01-25T04:46:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T04:46:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T04:46:45.581 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T04:46:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T04:46:45.582 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T04:46:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T04:46:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T04:46:45.583 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T04:46:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T04:46:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T04:46:45.584 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T04:46:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T04:46:45.585 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T04:46:45.586 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T04:46:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T04:46:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T04:46:45.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T04:46:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T04:46:45.588 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T04:46:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T04:46:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T04:46:45.589 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T04:46:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T04:46:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T04:46:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:45.591 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:46:45.591 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2023-01-25T04:46:45.592 INFO:teuthology.orchestra.run.smithi082.stdout:Install 32 Packages 2023-01-25T04:46:45.592 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:46:45.593 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 28 M 2023-01-25T04:46:45.594 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 110 M 2023-01-25T04:46:45.594 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:46:45.709 INFO:teuthology.orchestra.run.smithi082.stdout:(1/32): ceph-18.0.0-1963.g61996d73.el8.x86_64.r 50 kB/s | 6.4 kB 00:00 2023-01-25T04:46:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:(2/32): ceph-mds-18.0.0-1963.g61996d73.el8.x86_ 6.3 MB/s | 2.3 MB 00:00 2023-01-25T04:46:45.976 INFO:teuthology.orchestra.run.smithi082.stdout:(3/32): ceph-mgr-18.0.0-1963.g61996d73.el8.x86_ 3.9 MB/s | 1.5 MB 00:00 2023-01-25T04:46:46.060 INFO:teuthology.orchestra.run.smithi082.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1963.g6199 2.8 MB/s | 236 kB 00:00 2023-01-25T04:46:46.118 INFO:teuthology.orchestra.run.smithi082.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-25T04:46:46.135 INFO:teuthology.orchestra.run.smithi082.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 2.3 MB/s | 39 kB 00:00 2023-01-25T04:46:46.161 INFO:teuthology.orchestra.run.smithi082.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2023-01-25T04:46:46.178 INFO:teuthology.orchestra.run.smithi082.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 3.2 MB/s | 54 kB 00:00 2023-01-25T04:46:46.220 INFO:teuthology.orchestra.run.smithi082.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 11 MB/s | 457 kB 00:00 2023-01-25T04:46:46.237 INFO:teuthology.orchestra.run.smithi082.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 14 MB/s | 237 kB 00:00 2023-01-25T04:46:46.271 INFO:teuthology.orchestra.run.smithi082.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 16 MB/s | 559 kB 00:00 2023-01-25T04:46:46.296 INFO:teuthology.orchestra.run.smithi082.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2023-01-25T04:46:46.455 INFO:teuthology.orchestra.run.smithi082.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 275 kB/s | 44 kB 00:00 2023-01-25T04:46:46.563 INFO:teuthology.orchestra.run.smithi082.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.7 MB/s | 185 kB 00:00 2023-01-25T04:46:46.614 INFO:teuthology.orchestra.run.smithi082.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 3.4 MB/s | 173 kB 00:00 2023-01-25T04:46:46.806 INFO:teuthology.orchestra.run.smithi082.stdout:(16/32): ceph-osd-18.0.0-1963.g61996d73.el8.x86 20 MB/s | 17 MB 00:00 2023-01-25T04:46:46.831 INFO:teuthology.orchestra.run.smithi082.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2023-01-25T04:46:46.889 INFO:teuthology.orchestra.run.smithi082.stdout:(18/32): ceph-mon-18.0.0-1963.g61996d73.el8.x86 3.3 MB/s | 3.9 MB 00:01 2023-01-25T04:46:46.923 INFO:teuthology.orchestra.run.smithi082.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-01-25T04:46:46.948 INFO:teuthology.orchestra.run.smithi082.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 150 kB/s | 18 kB 00:00 2023-01-25T04:46:46.974 INFO:teuthology.orchestra.run.smithi082.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 580 kB/s | 49 kB 00:00 2023-01-25T04:46:46.999 INFO:teuthology.orchestra.run.smithi082.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 779 kB/s | 59 kB 00:00 2023-01-25T04:46:47.024 INFO:teuthology.orchestra.run.smithi082.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-01-25T04:46:47.050 INFO:teuthology.orchestra.run.smithi082.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 371 kB/s | 19 kB 00:00 2023-01-25T04:46:47.075 INFO:teuthology.orchestra.run.smithi082.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 474 kB/s | 24 kB 00:00 2023-01-25T04:46:47.100 INFO:teuthology.orchestra.run.smithi082.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 582 kB/s | 29 kB 00:00 2023-01-25T04:46:47.125 INFO:teuthology.orchestra.run.smithi082.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 546 kB/s | 27 kB 00:00 2023-01-25T04:46:47.151 INFO:teuthology.orchestra.run.smithi082.stdout:(28/32): python3-waitress-1.2.1-2.el8.1.noarch. 4.7 MB/s | 241 kB 00:00 2023-01-25T04:46:47.201 INFO:teuthology.orchestra.run.smithi082.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2023-01-25T04:46:47.226 INFO:teuthology.orchestra.run.smithi082.stdout:(30/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-01-25T04:46:47.251 INFO:teuthology.orchestra.run.smithi082.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.0 MB/s | 251 kB 00:00 2023-01-25T04:46:47.277 INFO:teuthology.orchestra.run.smithi082.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 304 kB/s | 23 kB 00:00 2023-01-25T04:46:47.279 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:46:47.280 INFO:teuthology.orchestra.run.smithi082.stdout:Total 17 MB/s | 28 MB 00:01 2023-01-25T04:46:47.357 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:46:47.393 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:46:47.393 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:46:47.763 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:46:47.766 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:46:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:46:49.236 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T04:46:49.514 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T04:46:49.785 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T04:46:50.071 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T04:46:50.276 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T04:46:50.465 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T04:46:50.675 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T04:46:50.853 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T04:46:51.067 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T04:46:51.321 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T04:46:51.592 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T04:46:51.816 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T04:46:52.220 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T04:46:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T04:46:52.679 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T04:46:52.929 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T04:46:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T04:46:53.513 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T04:46:53.744 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T04:46:53.957 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T04:46:54.143 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T04:46:54.403 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T04:46:54.650 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T04:46:54.875 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T04:46:55.238 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T04:46:55.586 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T04:46:55.963 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 27/32 2023-01-25T04:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T04:46:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T04:46:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T04:46:58.263 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T04:46:58.454 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T04:46:58.669 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T04:46:58.854 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T04:46:58.872 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T04:46:58.985 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T04:46:59.401 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T04:46:59.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 1/32 2023-01-25T04:46:59.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2/32 2023-01-25T04:46:59.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 3/32 2023-01-25T04:46:59.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 4/32 2023-01-25T04:46:59.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 5/32 2023-01-25T04:46:59.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 6/32 2023-01-25T04:46:59.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T04:46:59.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T04:46:59.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T04:46:59.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T04:46:59.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T04:46:59.403 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T04:46:59.404 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T04:46:59.404 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T04:46:59.404 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T04:46:59.404 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T04:46:59.405 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T04:46:59.405 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T04:46:59.405 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T04:46:59.405 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T04:46:59.405 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T04:46:59.406 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T04:46:59.406 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T04:46:59.406 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T04:46:59.406 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T04:46:59.406 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T04:46:59.407 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T04:46:59.407 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T04:46:59.408 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T04:46:59.408 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T04:46:59.408 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T04:47:00.309 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T04:47:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:47:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:47:00.311 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:47:00.311 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:00.311 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:47:00.311 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:47:00.311 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T04:47:00.312 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T04:47:00.312 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T04:47:00.312 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T04:47:00.312 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T04:47:00.313 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T04:47:00.313 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T04:47:00.313 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T04:47:00.313 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T04:47:00.313 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T04:47:00.314 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T04:47:00.314 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T04:47:00.314 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T04:47:00.314 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T04:47:00.314 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T04:47:00.315 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T04:47:00.315 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T04:47:00.315 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T04:47:00.315 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T04:47:00.316 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T04:47:00.316 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T04:47:00.316 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T04:47:00.316 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T04:47:00.317 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T04:47:00.317 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T04:47:00.317 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T04:47:00.317 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:00.317 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:00.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-base 2023-01-25T04:47:01.229 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:11 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:47:02.364 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:02.365 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:47:02.365 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:02.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install cephadm 2023-01-25T04:47:03.163 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:04.306 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:04.307 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:04.307 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:47:04.307 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:04.308 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:04.308 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 82 k 2023-01-25T04:47:04.308 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:04.308 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:04.309 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:04.309 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:47:04.309 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:04.309 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 82 k 2023-01-25T04:47:04.309 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 374 k 2023-01-25T04:47:04.309 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:04.490 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm-18.0.0-1963.g61996d73.el8.noarch.rpm 453 kB/s | 82 kB 00:00 2023-01-25T04:47:04.491 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:04.491 INFO:teuthology.orchestra.run.smithi082.stdout:Total 449 kB/s | 82 kB 00:00 2023-01-25T04:47:04.491 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:04.499 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:04.499 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:04.501 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:04.504 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:04.552 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:06.146 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T04:47:06.304 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T04:47:06.538 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T04:47:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T04:47:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:06.985 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:06.986 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:07.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T04:47:07.982 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:17 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:09.124 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:09.124 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2023-01-25T04:47:09.125 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:09.125 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1963.g61996d73.el8 ceph 165 k 2023-01-25T04:47:09.125 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:09.126 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:09.126 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:09.126 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:47:09.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:09.127 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 165 k 2023-01-25T04:47:09.127 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 503 k 2023-01-25T04:47:09.127 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:09.612 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-immutable-object-cache-18.0.0-1963.g61996d 341 kB/s | 165 kB 00:00 2023-01-25T04:47:09.612 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:09.613 INFO:teuthology.orchestra.run.smithi082.stdout:Total 340 kB/s | 165 kB 00:00 2023-01-25T04:47:09.613 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:09.624 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:09.625 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:09.674 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:09.678 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:09.977 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T04:47:10.404 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T04:47:10.876 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T04:47:10.876 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:10.876 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:10.877 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:47:10.877 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:10.877 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:11.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr 2023-01-25T04:47:11.796 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:21 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:12.832 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:47:12.931 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:12.932 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:47:12.933 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:13.029 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T04:47:13.756 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:23 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:14.888 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:14.889 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:14.889 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:47:14.889 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:14.889 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:14.890 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 1.7 M 2023-01-25T04:47:14.890 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:47:14.890 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 23 k 2023-01-25T04:47:14.890 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 15 k 2023-01-25T04:47:14.891 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T04:47:14.891 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T04:47:14.891 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T04:47:14.891 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:14.892 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:14.892 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:14.892 INFO:teuthology.orchestra.run.smithi082.stdout:Install 6 Packages 2023-01-25T04:47:14.892 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:14.893 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 2.0 M 2023-01-25T04:47:14.893 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 8.2 M 2023-01-25T04:47:14.893 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:15.583 INFO:teuthology.orchestra.run.smithi082.stdout:(1/6): ceph-prometheus-alerts-18.0.0-1963.g6199 21 kB/s | 15 kB 00:00 2023-01-25T04:47:15.608 INFO:teuthology.orchestra.run.smithi082.stdout:(2/6): ceph-grafana-dashboards-18.0.0-1963.g619 32 kB/s | 23 kB 00:00 2023-01-25T04:47:15.690 INFO:teuthology.orchestra.run.smithi082.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 399 kB/s | 43 kB 00:00 2023-01-25T04:47:15.750 INFO:teuthology.orchestra.run.smithi082.stdout:(4/6): ceph-mgr-dashboard-18.0.0-1963.g61996d73 2.0 MB/s | 1.7 MB 00:00 2023-01-25T04:47:15.776 INFO:teuthology.orchestra.run.smithi082.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 201 kB/s | 34 kB 00:00 2023-01-25T04:47:15.892 INFO:teuthology.orchestra.run.smithi082.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 973 kB/s | 196 kB 00:00 2023-01-25T04:47:15.895 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:15.895 INFO:teuthology.orchestra.run.smithi082.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2023-01-25T04:47:15.907 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:15.916 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:15.916 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:16.004 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:16.008 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:16.295 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:16.513 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T04:47:16.759 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T04:47:16.936 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T04:47:17.039 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 4/6 2023-01-25T04:47:17.411 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 5/6 2023-01-25T04:47:17.627 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T04:47:17.933 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T04:47:17.933 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 1/6 2023-01-25T04:47:17.933 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 2/6 2023-01-25T04:47:17.934 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 3/6 2023-01-25T04:47:17.934 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T04:47:17.934 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T04:47:18.427 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T04:47:18.428 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:18.428 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:18.428 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:18.429 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:18.429 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:18.429 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T04:47:18.429 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T04:47:18.429 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T04:47:18.430 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:18.430 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:18.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T04:47:19.250 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:29 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:20.398 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout:===================================================================================================== 2023-01-25T04:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:47:20.399 INFO:teuthology.orchestra.run.smithi082.stdout:===================================================================================================== 2023-01-25T04:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 7.4 M 2023-01-25T04:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:47:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T04:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T04:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T04:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T04:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T04:47:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T04:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T04:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:===================================================================================================== 2023-01-25T04:47:20.402 INFO:teuthology.orchestra.run.smithi082.stdout:Install 8 Packages 2023-01-25T04:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 35 M 2023-01-25T04:47:20.403 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 210 M 2023-01-25T04:47:20.404 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:20.599 INFO:teuthology.orchestra.run.smithi082.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2023-01-25T04:47:20.749 INFO:teuthology.orchestra.run.smithi082.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2023-01-25T04:47:20.825 INFO:teuthology.orchestra.run.smithi082.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 17 MB/s | 3.7 MB 00:00 2023-01-25T04:47:20.850 INFO:teuthology.orchestra.run.smithi082.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.2 MB/s | 225 kB 00:00 2023-01-25T04:47:20.892 INFO:teuthology.orchestra.run.smithi082.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 15 MB/s | 645 kB 00:00 2023-01-25T04:47:20.925 INFO:teuthology.orchestra.run.smithi082.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 5.0 MB/s | 172 kB 00:00 2023-01-25T04:47:21.176 INFO:teuthology.orchestra.run.smithi082.stdout:(7/8): python3-scipy-1.0.0-21.module_el8.5.0+77 39 MB/s | 14 MB 00:00 2023-01-25T04:47:22.117 INFO:teuthology.orchestra.run.smithi082.stdout:(8/8): ceph-mgr-diskprediction-local-18.0.0-196 4.3 MB/s | 7.4 MB 00:01 2023-01-25T04:47:22.120 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:22.120 INFO:teuthology.orchestra.run.smithi082.stdout:Total 21 MB/s | 35 MB 00:01 2023-01-25T04:47:22.350 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:22.369 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:22.369 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:22.787 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:23.364 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:23.556 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T04:47:23.695 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T04:47:23.840 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T04:47:24.426 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T04:47:24.614 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:47:25.226 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:47:25.431 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T04:47:26.118 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T04:47:26.517 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:47:26.739 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:47:28.524 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:47:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T04:47:29.988 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T04:47:30.305 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T04:47:30.306 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 1/8 2023-01-25T04:47:30.306 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T04:47:30.306 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:47:30.306 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T04:47:30.307 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:47:30.307 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T04:47:30.307 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T04:47:30.821 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T04:47:30.822 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:30.822 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:30.822 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:30.822 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T04:47:30.823 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T04:47:30.823 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T04:47:30.823 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T04:47:30.823 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T04:47:30.823 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T04:47:30.824 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T04:47:30.824 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:30.824 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:32.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-rook 2023-01-25T04:47:32.755 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:42 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:33.893 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:33.894 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================== 2023-01-25T04:47:33.895 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:47:33.895 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================== 2023-01-25T04:47:33.895 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:33.895 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 47 k 2023-01-25T04:47:33.895 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:47:33.896 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T04:47:33.896 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T04:47:33.896 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T04:47:33.896 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T04:47:33.896 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T04:47:33.897 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T04:47:33.897 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T04:47:33.897 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T04:47:33.897 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T04:47:33.897 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T04:47:33.897 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T04:47:33.898 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T04:47:33.898 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:33.898 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:33.898 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================== 2023-01-25T04:47:33.898 INFO:teuthology.orchestra.run.smithi082.stdout:Install 13 Packages 2023-01-25T04:47:33.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:33.899 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 1.9 M 2023-01-25T04:47:33.900 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 25 M 2023-01-25T04:47:33.900 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:33.957 INFO:teuthology.orchestra.run.smithi082.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 456 kB/s | 27 kB 00:00 2023-01-25T04:47:33.990 INFO:teuthology.orchestra.run.smithi082.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 217 kB/s | 20 kB 00:00 2023-01-25T04:47:34.016 INFO:teuthology.orchestra.run.smithi082.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-01-25T04:47:34.041 INFO:teuthology.orchestra.run.smithi082.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T04:47:34.058 INFO:teuthology.orchestra.run.smithi082.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 2.5 MB/s | 43 kB 00:00 2023-01-25T04:47:34.075 INFO:teuthology.orchestra.run.smithi082.stdout:(6/13): ceph-mgr-rook-18.0.0-1963.g61996d73.el8 267 kB/s | 47 kB 00:00 2023-01-25T04:47:34.124 INFO:teuthology.orchestra.run.smithi082.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.4 MB/s | 155 kB 00:00 2023-01-25T04:47:34.209 INFO:teuthology.orchestra.run.smithi082.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 219 kB/s | 33 kB 00:00 2023-01-25T04:47:34.226 INFO:teuthology.orchestra.run.smithi082.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 108 kB/s | 16 kB 00:00 2023-01-25T04:47:34.259 INFO:teuthology.orchestra.run.smithi082.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 600 kB/s | 81 kB 00:00 2023-01-25T04:47:34.302 INFO:teuthology.orchestra.run.smithi082.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 817 kB/s | 61 kB 00:00 2023-01-25T04:47:34.327 INFO:teuthology.orchestra.run.smithi082.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 915 kB/s | 61 kB 00:00 2023-01-25T04:47:34.444 INFO:teuthology.orchestra.run.smithi082.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.0 MB/s | 1.2 MB 00:00 2023-01-25T04:47:34.445 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:34.446 INFO:teuthology.orchestra.run.smithi082.stdout:Total 3.5 MB/s | 1.9 MB 00:00 2023-01-25T04:47:34.497 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:34.512 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:34.512 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:34.609 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:34.612 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:35.115 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:35.399 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T04:47:35.613 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T04:47:35.881 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T04:47:36.135 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T04:47:36.342 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T04:47:36.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T04:47:36.880 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T04:47:37.166 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T04:47:38.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T04:47:38.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T04:47:39.076 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T04:47:39.270 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T04:47:39.419 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T04:47:39.722 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T04:47:39.722 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 1/13 2023-01-25T04:47:39.722 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T04:47:39.723 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T04:47:39.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T04:47:39.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T04:47:39.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T04:47:39.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T04:47:39.724 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T04:47:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T04:47:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:40.264 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T04:47:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T04:47:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T04:47:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T04:47:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T04:47:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T04:47:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T04:47:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T04:47:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T04:47:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T04:47:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T04:47:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T04:47:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:40.267 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:40.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T04:47:41.117 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:51 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:42.260 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:42.261 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:42.262 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:47:42.262 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:42.262 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:42.262 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 120 k 2023-01-25T04:47:42.262 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:47:42.263 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T04:47:42.263 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T04:47:42.263 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T04:47:42.263 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T04:47:42.263 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:42.264 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:42.264 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:42.264 INFO:teuthology.orchestra.run.smithi082.stdout:Install 5 Packages 2023-01-25T04:47:42.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:42.265 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 6.0 M 2023-01-25T04:47:42.265 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 26 M 2023-01-25T04:47:42.265 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:42.350 INFO:teuthology.orchestra.run.smithi082.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.2 MB/s | 538 kB 00:00 2023-01-25T04:47:42.450 INFO:teuthology.orchestra.run.smithi082.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-01-25T04:47:42.500 INFO:teuthology.orchestra.run.smithi082.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1963.g61996d73.e 509 kB/s | 120 kB 00:00 2023-01-25T04:47:42.584 INFO:teuthology.orchestra.run.smithi082.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.0 MB/s | 476 kB 00:00 2023-01-25T04:47:42.609 INFO:teuthology.orchestra.run.smithi082.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 380 kB/s | 60 kB 00:00 2023-01-25T04:47:42.610 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:42.611 INFO:teuthology.orchestra.run.smithi082.stdout:Total 17 MB/s | 6.0 MB 00:00 2023-01-25T04:47:42.662 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:42.673 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:42.674 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:42.808 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:42.811 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:43.107 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:43.400 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T04:47:44.352 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T04:47:44.771 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T04:47:45.013 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T04:47:45.202 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T04:47:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T04:47:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/5 2023-01-25T04:47:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T04:47:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T04:47:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T04:47:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T04:47:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T04:47:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T04:47:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T04:47:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T04:47:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:46.016 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:46.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-fuse 2023-01-25T04:47:46.852 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:56 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:47.990 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:47.990 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:47:47.991 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:47.991 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 845 k 2023-01-25T04:47:47.991 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2023-01-25T04:47:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T04:47:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:47.992 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:47.992 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:47.992 INFO:teuthology.orchestra.run.smithi082.stdout:Install 2 Packages 2023-01-25T04:47:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:47.993 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 928 k 2023-01-25T04:47:47.994 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 2.9 M 2023-01-25T04:47:47.994 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:48.057 INFO:teuthology.orchestra.run.smithi082.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.3 MB/s | 83 kB 00:00 2023-01-25T04:47:48.324 INFO:teuthology.orchestra.run.smithi082.stdout:(2/2): ceph-fuse-18.0.0-1963.g61996d73.el8.x86_ 2.5 MB/s | 845 kB 00:00 2023-01-25T04:47:48.326 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:48.326 INFO:teuthology.orchestra.run.smithi082.stdout:Total 2.7 MB/s | 928 kB 00:00 2023-01-25T04:47:48.336 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:48.357 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:48.357 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:48.451 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:48.454 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T04:47:49.099 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T04:47:49.515 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T04:47:49.515 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/2 2023-01-25T04:47:50.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T04:47:50.036 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:50.037 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:50.037 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T04:47:50.037 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:50.037 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:50.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-volume 2023-01-25T04:47:50.970 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:00 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:52.112 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:52.113 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:52.113 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2023-01-25T04:47:52.114 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:52.114 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:52.114 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 263 k 2023-01-25T04:47:52.114 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:52.114 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:52.115 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:52.115 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:47:52.115 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:52.115 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 263 k 2023-01-25T04:47:52.115 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 1.3 M 2023-01-25T04:47:52.116 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:52.336 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-volume-18.0.0-1963.g61996d73.el8.noarch.rp 1.2 MB/s | 263 kB 00:00 2023-01-25T04:47:52.336 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:52.337 INFO:teuthology.orchestra.run.smithi082.stdout:Total 1.2 MB/s | 263 kB 00:00 2023-01-25T04:47:52.337 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:52.435 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:52.438 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:52.638 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:52.892 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T04:47:53.327 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T04:47:53.870 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:53.871 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:54.048 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados-devel 2023-01-25T04:47:54.776 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:04 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:55.923 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:55.923 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:55.923 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2023-01-25T04:47:55.923 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:55.924 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:47:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 139 k 2023-01-25T04:47:55.924 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:55.924 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:47:55.924 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:47:55.925 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:47:55.925 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:55.925 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 139 k 2023-01-25T04:47:55.925 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 512 k 2023-01-25T04:47:55.925 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:47:56.197 INFO:teuthology.orchestra.run.smithi082.stdout:librados-devel-18.0.0-1963.g61996d73.el8.x86_64 498 kB/s | 139 kB 00:00 2023-01-25T04:47:56.198 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:47:56.198 INFO:teuthology.orchestra.run.smithi082.stdout:Total 496 kB/s | 139 kB 00:00 2023-01-25T04:47:56.199 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:47:56.204 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:47:56.204 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:47:56.255 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:47:56.259 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:47:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:47:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:47:56.840 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:47:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:47:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:57.348 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:47:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:47:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:47:57.349 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:47:57.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs2 2023-01-25T04:47:58.307 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:08 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:47:59.354 INFO:teuthology.orchestra.run.smithi082.stdout:Package libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:47:59.455 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:47:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:47:59.456 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:00.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs-devel 2023-01-25T04:48:01.020 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:11 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:02.162 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2023-01-25T04:48:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:48:02.163 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 30 k 2023-01-25T04:48:02.163 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:48:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:48:02.164 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 30 k 2023-01-25T04:48:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 137 k 2023-01-25T04:48:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:48:02.320 INFO:teuthology.orchestra.run.smithi082.stdout:libcephfs-devel-18.0.0-1963.g61996d73.el8.x86_6 195 kB/s | 30 kB 00:00 2023-01-25T04:48:02.320 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:48:02.321 INFO:teuthology.orchestra.run.smithi082.stdout:Total 193 kB/s | 30 kB 00:00 2023-01-25T04:48:02.321 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:48:02.324 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:48:02.324 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:48:02.342 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:48:02.346 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:48:02.408 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:48:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:02.867 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:03.329 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:03.329 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:03.329 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:48:03.330 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:48:03.330 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:03.330 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:03.439 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados2 2023-01-25T04:48:04.167 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:14 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:05.204 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:48:05.303 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:05.305 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:48:05.305 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:05.398 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librbd1 2023-01-25T04:48:06.128 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:16 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:07.164 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:48:07.263 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:07.265 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:48:07.265 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:07.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rados 2023-01-25T04:48:08.080 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:18 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:09.126 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:48:09.225 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:09.226 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:48:09.226 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:09.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rgw 2023-01-25T04:48:10.037 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:11.069 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:48:11.168 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:11.169 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:48:11.170 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:11.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-cephfs 2023-01-25T04:48:11.982 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:21 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:13.027 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:48:13.127 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:13.128 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:48:13.129 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:13.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rbd 2023-01-25T04:48:13.936 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:23 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:14.973 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T04:48:15.073 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:15.074 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2023-01-25T04:48:15.075 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:15.173 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-fuse 2023-01-25T04:48:15.898 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:25 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:17.039 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:17.040 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:17.040 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2023-01-25T04:48:17.040 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:17.041 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:48:17.041 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 94 k 2023-01-25T04:48:17.041 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:17.041 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:48:17.041 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:17.041 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:48:17.042 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:17.042 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 94 k 2023-01-25T04:48:17.042 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 280 k 2023-01-25T04:48:17.042 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:48:17.233 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-fuse-18.0.0-1963.g61996d73.el8.x86_64.rpm 490 kB/s | 94 kB 00:00 2023-01-25T04:48:17.234 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:48:17.234 INFO:teuthology.orchestra.run.smithi082.stdout:Total 487 kB/s | 94 kB 00:00 2023-01-25T04:48:17.235 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:48:17.244 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:48:17.245 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:48:17.295 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:48:17.299 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:48:17.408 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:48:17.633 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:17.927 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:18.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:18.394 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:18.394 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:48:18.395 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:48:18.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:18.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-mirror 2023-01-25T04:48:19.346 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:29 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:20.480 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:20.481 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2023-01-25T04:48:20.482 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:20.482 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:48:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.4 M 2023-01-25T04:48:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:20.483 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:48:20.483 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:20.483 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:48:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:20.484 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 3.4 M 2023-01-25T04:48:20.484 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 16 M 2023-01-25T04:48:20.484 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:48:20.928 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-mirror-18.0.0-1963.g61996d73.el8.x86_64.rpm 7.7 MB/s | 3.4 MB 00:00 2023-01-25T04:48:20.929 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:48:20.929 INFO:teuthology.orchestra.run.smithi082.stdout:Total 7.7 MB/s | 3.4 MB 00:00 2023-01-25T04:48:20.929 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:48:20.941 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:48:20.941 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:48:21.003 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:48:21.007 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:48:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:48:21.644 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:22.081 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:22.581 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:48:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:48:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:22.582 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:22.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-nbd 2023-01-25T04:48:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:02:33 ago on Wed 25 Jan 2023 04:45:50 AM UTC. 2023-01-25T04:48:24.662 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2023-01-25T04:48:24.662 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:24.663 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2023-01-25T04:48:24.663 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:24.663 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2023-01-25T04:48:24.663 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 179 k 2023-01-25T04:48:24.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:24.664 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2023-01-25T04:48:24.664 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2023-01-25T04:48:24.664 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2023-01-25T04:48:24.664 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:24.665 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 179 k 2023-01-25T04:48:24.665 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 568 k 2023-01-25T04:48:24.666 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2023-01-25T04:48:24.865 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-nbd-18.0.0-1963.g61996d73.el8.x86_64.rpm 896 kB/s | 179 kB 00:00 2023-01-25T04:48:24.865 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:48:24.866 INFO:teuthology.orchestra.run.smithi082.stdout:Total 891 kB/s | 179 kB 00:00 2023-01-25T04:48:24.866 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2023-01-25T04:48:24.876 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2023-01-25T04:48:24.877 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2023-01-25T04:48:24.930 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2023-01-25T04:48:24.933 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2023-01-25T04:48:25.059 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2023-01-25T04:48:25.265 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:25.576 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:26.056 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T04:48:26.056 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:26.056 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2023-01-25T04:48:26.056 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T04:48:26.057 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-01-25T04:48:26.057 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2023-01-25T04:48:26.271 DEBUG:teuthology.parallel:result is None 2023-01-25T04:48:26.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo lsb_release -is 2023-01-25T04:48:26.309 INFO:teuthology.orchestra.run.smithi082.stdout:CentOSStream 2023-01-25T04:48:26.310 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:48:26.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T04:48:26.459 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T04:48:26.481 INFO:teuthology.orchestra.run.smithi082.stdout:18.0.0-1963.g61996d73.el8 2023-01-25T04:48:26.481 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1963.g61996d73.el8 2023-01-25T04:48:26.482 INFO:teuthology.task.install:The correct ceph version 18.0.0-1963.g61996d73 is installed. 2023-01-25T04:48:26.482 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T04:48:26.482 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-01-25T04:48:26.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T04:48:26.548 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T04:48:26.548 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-01-25T04:48:26.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T04:48:26.615 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T04:48:26.681 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T04:48:26.681 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-01-25T04:48:26.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T04:48:26.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T04:48:26.815 INFO:teuthology.run_tasks:Running task workunit... 2023-01-25T04:48:26.827 INFO:tasks.workunit:Pulling workunits from ref 61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T04:48:26.828 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-01-25T04:48:26.828 INFO:tasks.workunit:timeout=3h 2023-01-25T04:48:26.828 INFO:tasks.workunit:cleanup=True 2023-01-25T04:48:26.829 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2023-01-25T04:48:26.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:48:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-01-25T04:48:26.873 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-01-25T04:48:26.931 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-01-25T04:48:26.931 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-01-25T04:48:26.988 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T04:48:27.047 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-01-25T04:49:05.341 INFO:tasks.workunit.client.0.smithi082.stderr:Note: switching to '61996d73ab738798e4ee0055c86457f5c459da4a'. 2023-01-25T04:49:05.341 INFO:tasks.workunit.client.0.smithi082.stderr: 2023-01-25T04:49:05.341 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-01-25T04:49:05.341 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2023-01-25T04:49:05.342 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by switching back to a branch. 2023-01-25T04:49:05.342 INFO:tasks.workunit.client.0.smithi082.stderr: 2023-01-25T04:49:05.342 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2023-01-25T04:49:05.342 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2023-01-25T04:49:05.342 INFO:tasks.workunit.client.0.smithi082.stderr: 2023-01-25T04:49:05.343 INFO:tasks.workunit.client.0.smithi082.stderr: git switch -c 2023-01-25T04:49:05.343 INFO:tasks.workunit.client.0.smithi082.stderr: 2023-01-25T04:49:05.343 INFO:tasks.workunit.client.0.smithi082.stderr:Or undo this operation with: 2023-01-25T04:49:05.343 INFO:tasks.workunit.client.0.smithi082.stderr: 2023-01-25T04:49:05.343 INFO:tasks.workunit.client.0.smithi082.stderr: git switch - 2023-01-25T04:49:05.344 INFO:tasks.workunit.client.0.smithi082.stderr: 2023-01-25T04:49:05.344 INFO:tasks.workunit.client.0.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-01-25T04:49:05.344 INFO:tasks.workunit.client.0.smithi082.stderr: 2023-01-25T04:49:05.344 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at 61996d73ab7 Merge branch 'wip-tserong-qa-crash-chown' of https://github.com/SUSE/ceph into wip-yuri2-testing-2023-01-23-0928 2023-01-25T04:49:05.345 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-01-25T04:49:05.404 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-01-25T04:49:05.405 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-01-25T04:49:05.463 INFO:tasks.workunit:Running workunits matching crush on client.0... 2023-01-25T04:49:05.463 INFO:tasks.workunit:Running workunit crush/crush-choose-args.sh... 2023-01-25T04:49:05.464 DEBUG:teuthology.orchestra.run.smithi082:workunit test crush/crush-choose-args.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=61996d73ab738798e4ee0055c86457f5c459da4a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh 2023-01-25T04:49:05.610 INFO:tasks.workunit.client.0.smithi082.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-01-25T04:49:05.619 INFO:tasks.workunit.client.0.smithi082.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2023-01-25T04:49:05.619 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-01-25T04:49:05.619 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-01-25T04:49:05.619 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2238: main: export PYTHONWARNINGS=ignore 2023-01-25T04:49:05.619 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2238: main: PYTHONWARNINGS=ignore 2023-01-25T04:49:05.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: main: export CEPH_CONF=/dev/null 2023-01-25T04:49:05.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: main: CEPH_CONF=/dev/null 2023-01-25T04:49:05.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2240: main: unset CEPH_ARGS 2023-01-25T04:49:05.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2242: main: local code 2023-01-25T04:49:05.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2243: main: run td/crush-choose-args 2023-01-25T04:49:05.621 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:21: run: local dir=td/crush-choose-args 2023-01-25T04:49:05.621 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:22: run: shift 2023-01-25T04:49:05.621 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:24: run: export CEPH_MON=127.0.0.1:7131 2023-01-25T04:49:05.621 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:24: run: CEPH_MON=127.0.0.1:7131 2023-01-25T04:49:05.621 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:25: run: export CEPH_ARGS 2023-01-25T04:49:05.622 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:26: run: uuidgen 2023-01-25T04:49:05.629 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:26: run: CEPH_ARGS+='--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none ' 2023-01-25T04:49:05.629 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7131 ' 2023-01-25T04:49:05.629 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:28: run: CEPH_ARGS+='--crush-location=root=default,host=HOST ' 2023-01-25T04:49:05.630 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:29: run: CEPH_ARGS+='--osd-crush-initial-weight=3 ' 2023-01-25T04:49:05.630 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:35: run: CEPH_ARGS+='--osd-class-update-on-start=false ' 2023-01-25T04:49:05.630 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:37: run: set 2023-01-25T04:49:05.630 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:37: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2023-01-25T04:49:05.632 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:37: run: local 'funcs=TEST_choose_args_update 2023-01-25T04:49:05.632 INFO:tasks.workunit.client.0.smithi082.stderr:TEST_move_bucket 2023-01-25T04:49:05.632 INFO:tasks.workunit.client.0.smithi082.stderr:TEST_no_update_weight_set 2023-01-25T04:49:05.632 INFO:tasks.workunit.client.0.smithi082.stderr:TEST_reweight' 2023-01-25T04:49:05.632 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:38: run: for func in $funcs 2023-01-25T04:49:05.633 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:39: run: setup td/crush-choose-args 2023-01-25T04:49:05.633 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/crush-choose-args 2023-01-25T04:49:05.633 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/crush-choose-args 2023-01-25T04:49:05.633 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:49:05.634 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:49:05.634 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:49:05.634 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:49:05.634 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:49:05.634 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:49:05.635 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:49:05.635 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:49:05.636 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:49:05.636 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:49:05.636 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:49:05.636 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:49:05.637 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:49:05.637 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:49:05.637 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:49:05.638 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:49:05.638 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:49:05.639 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:49:05.639 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:49:05.639 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:49:05.639 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:49:05.639 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:49:05.640 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:49:05.641 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:05.641 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:05.641 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:49:05.641 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:49:05.642 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:49:05.642 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/crush-choose-args 2023-01-25T04:49:05.644 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2023-01-25T04:49:05.644 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:05.644 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:05.644 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.99479 2023-01-25T04:49:05.645 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2023-01-25T04:49:05.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2023-01-25T04:49:05.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2023-01-25T04:49:05.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2023-01-25T04:49:05.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/crush-choose-args 1' TERM HUP INT 2023-01-25T04:49:05.646 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:40: run: TEST_choose_args_update td/crush-choose-args 2023-01-25T04:49:05.646 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:49: TEST_choose_args_update: local dir=td/crush-choose-args 2023-01-25T04:49:05.646 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:51: TEST_choose_args_update: run_mon td/crush-choose-args a 2023-01-25T04:49:05.646 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/crush-choose-args 2023-01-25T04:49:05.646 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2023-01-25T04:49:05.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2023-01-25T04:49:05.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2023-01-25T04:49:05.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/crush-choose-args/a 2023-01-25T04:49:05.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/crush-choose-args/a --run-dir=td/crush-choose-args 2023-01-25T04:49:06.011 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2023-01-25T04:49:06.011 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:49:06.012 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:49:06.012 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:49:06.012 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:06.012 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:06.013 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:49:06.013 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/crush-choose-args/a '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --mon-cluster-log-file=td/crush-choose-args/log --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2023-01-25T04:49:06.248 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2023-01-25T04:49:06.250 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2023-01-25T04:49:06.250 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:49:06.250 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:49:06.251 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=fsid 2023-01-25T04:49:06.251 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .fsid 2023-01-25T04:49:06.251 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:49:06.251 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:49:06.251 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:49:06.252 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:49:06.252 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:06.252 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:06.252 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:49:06.252 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:49:06.253 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get fsid 2023-01-25T04:49:06.352 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2023-01-25T04:49:06.352 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:49:06.353 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:49:06.353 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=mon_host 2023-01-25T04:49:06.353 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .mon_host 2023-01-25T04:49:06.353 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:49:06.353 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:49:06.354 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:49:06.354 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:49:06.354 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:06.354 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:06.354 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:49:06.355 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:49:06.355 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get mon_host 2023-01-25T04:49:06.453 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:52: TEST_choose_args_update: run_mgr td/crush-choose-args x 2023-01-25T04:49:06.453 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/crush-choose-args 2023-01-25T04:49:06.454 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2023-01-25T04:49:06.454 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2023-01-25T04:49:06.454 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2023-01-25T04:49:06.454 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/crush-choose-args/x 2023-01-25T04:49:06.454 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2023-01-25T04:49:07.337 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2023-01-25T04:49:07.338 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:49:07.338 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:49:07.338 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:49:07.338 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:07.338 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:07.339 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:49:07.339 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:49:07.339 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/crush-choose-args/x '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:49:07.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:53: TEST_choose_args_update: run_osd td/crush-choose-args 0 2023-01-25T04:49:07.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:49:07.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:49:07.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2023-01-25T04:49:07.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:49:07.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/0 2023-01-25T04:49:07.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false ' 2023-01-25T04:49:07.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:49:07.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:49:07.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:49:07.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/0' 2023-01-25T04:49:07.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/0/journal' 2023-01-25T04:49:07.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:49:07.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:49:07.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:49:07.374 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:49:07.375 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:49:07.375 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:49:07.375 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:49:07.375 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:07.375 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:07.376 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:49:07.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:49:07.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:49:07.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:49:07.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:49:07.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:49:07.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:49:07.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:49:07.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:49:07.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:49:07.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:49:07.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:49:07.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/0 2023-01-25T04:49:07.378 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:49:07.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=3ae73f04-e50f-439a-8976-5d3c8c2de538 2023-01-25T04:49:07.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd0 3ae73f04-e50f-439a-8976-5d3c8c2de538' 2023-01-25T04:49:07.379 INFO:tasks.workunit.client.0.smithi082.stdout:add osd0 3ae73f04-e50f-439a-8976-5d3c8c2de538 2023-01-25T04:49:07.380 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:49:07.392 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQDDtNBjGLNLFxAA+MsR/ykyieLouu2ciyiWmQ== 2023-01-25T04:49:07.392 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQDDtNBjGLNLFxAA+MsR/ykyieLouu2ciyiWmQ=="}' 2023-01-25T04:49:07.393 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 3ae73f04-e50f-439a-8976-5d3c8c2de538 -i td/crush-choose-args/0/new.json 2023-01-25T04:49:07.792 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:49:07.804 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/0/new.json 2023-01-25T04:49:07.805 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDDtNBjGLNLFxAA+MsR/ykyieLouu2ciyiWmQ== --osd-uuid 3ae73f04-e50f-439a-8976-5d3c8c2de538 2023-01-25T04:49:07.834 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:07.833+0000 7ff1766255c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:07.842 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:07.842+0000 7ff1766255c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:07.843 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:07.842+0000 7ff1766255c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:07.844 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:07.843+0000 7ff1766255c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:49:07.844 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:07.843+0000 7ff1766255c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:49:07.844 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:07.843+0000 7ff1766255c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:49:07.943 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:07.942+0000 7ff1766255c0 -1 bluestore(td/crush-choose-args/0) _read_fsid unparsable uuid 2023-01-25T04:49:13.273 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/0/keyring 2023-01-25T04:49:13.274 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:49:13.274 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd0 key to auth repository 2023-01-25T04:49:13.275 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd0 key to auth repository 2023-01-25T04:49:13.275 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:49:13.521 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.0 2023-01-25T04:49:13.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.0 2023-01-25T04:49:13.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:49:13.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:49:13.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:49:13.523 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:49:13.549 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:13.548+0000 7f191ca105c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:13.551 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:13.551+0000 7f191ca105c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:13.552 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:13.552+0000 7f191ca105c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:13.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 0 2023-01-25T04:49:13.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:49:13.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=0 2023-01-25T04:49:13.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:49:13.758 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:49:13.758 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:13.758 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:49:13.758 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:49:13.759 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:13.759 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:14.002 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:14.073 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:14.073+0000 7f191ca105c0 -1 Falling back to public interface 2023-01-25T04:49:15.004 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:15.004 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:15.004 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:49:15.005 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:49:15.005 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:15.005 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:15.483 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:16.485 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:16.485 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:16.485 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:49:16.486 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:49:16.486 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:16.486 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:16.605 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:16.603+0000 7f191ca105c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:49:16.927 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:17.929 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:17.929 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:17.929 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:49:17.930 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:49:17.930 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:17.930 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:18.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:19.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:19.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:19.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:49:19.375 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:49:19.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:19.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:19.817 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:20.818 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:20.818 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:20.819 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:49:20.819 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:49:20.819 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:20.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:21.346 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:22.347 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:22.348 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:22.348 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:49:22.349 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:49:22.349 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:22.349 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:22.790 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:23.791 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:23.791 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:23.791 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:49:23.792 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:49:23.792 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:23.792 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:24.300 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:25.301 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:25.301 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:25.302 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:49:25.302 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:49:25.303 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:25.303 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:25.747 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:26.748 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:26.749 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:26.749 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:49:26.749 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:49:26.750 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:26.750 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:27.193 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:28.198 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:28.198 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:28.198 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:49:28.199 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:49:28.200 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:28.200 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:28.954 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:29.955 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:29.955 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:29.955 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:49:29.956 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:49:29.956 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:29.957 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:30.958 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:31.959 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:31.959 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:31.959 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:49:31.960 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:49:31.960 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:31.961 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:32.409 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:33.410 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:33.411 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:33.411 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:49:33.411 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:49:33.412 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:33.412 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:34.088 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:35.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:35.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:35.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:49:35.090 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:49:35.090 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:35.091 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:35.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:36.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:36.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:36.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:49:36.890 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:49:36.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:36.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:37.332 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:38.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:38.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:38.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:49:38.335 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:49:38.335 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:38.336 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:39.128 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:40.129 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:40.130 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:40.130 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:49:40.131 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:49:40.131 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:40.131 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:49:40.609 INFO:tasks.workunit.client.0.smithi082.stdout:osd.0 up in weight 1 up_from 4 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/100541,v1:127.0.0.1:6803/100541] [v2:127.0.0.1:6804/100541,v1:127.0.0.1:6805/100541] exists,up 3ae73f04-e50f-439a-8976-5d3c8c2de538 2023-01-25T04:49:40.610 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:49:40.610 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:49:40.611 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:49:40.611 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:55: TEST_choose_args_update: ceph osd set-require-min-compat-client luminous 2023-01-25T04:49:41.370 INFO:tasks.workunit.client.0.smithi082.stderr:set require_min_compat_client to luminous 2023-01-25T04:49:41.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:56: TEST_choose_args_update: ceph osd getcrushmap 2023-01-25T04:49:41.820 INFO:tasks.workunit.client.0.smithi082.stderr:2 2023-01-25T04:49:41.830 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:57: TEST_choose_args_update: crushtool -d td/crush-choose-args/map -o td/crush-choose-args/map.txt 2023-01-25T04:49:41.849 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:58: TEST_choose_args_update: sed -i -e '/end crush map/d' td/crush-choose-args/map.txt 2023-01-25T04:49:41.850 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:59: TEST_choose_args_update: cat 2023-01-25T04:49:41.851 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:82: TEST_choose_args_update: crushtool -c td/crush-choose-args/map.txt -o td/crush-choose-args/map-new 2023-01-25T04:49:41.869 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:83: TEST_choose_args_update: ceph osd setcrushmap -i td/crush-choose-args/map-new 2023-01-25T04:49:42.775 INFO:tasks.workunit.client.0.smithi082.stderr:4 2023-01-25T04:49:42.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:84: TEST_choose_args_update: ceph osd crush tree 2023-01-25T04:49:43.242 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT 0 TYPE NAME 2023-01-25T04:49:43.242 INFO:tasks.workunit.client.0.smithi082.stdout:-1 3.00000 root default 2023-01-25T04:49:43.242 INFO:tasks.workunit.client.0.smithi082.stdout:-2 3.00000 2.00000 host HOST 2023-01-25T04:49:43.242 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:49:43.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:86: TEST_choose_args_update: run_osd td/crush-choose-args 1 2023-01-25T04:49:43.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:49:43.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:49:43.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2023-01-25T04:49:43.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:49:43.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/1 2023-01-25T04:49:43.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false ' 2023-01-25T04:49:43.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:49:43.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:49:43.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:49:43.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/1' 2023-01-25T04:49:43.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/1/journal' 2023-01-25T04:49:43.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:49:43.259 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:49:43.259 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:49:43.259 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:49:43.259 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:49:43.260 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:49:43.260 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:49:43.260 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:49:43.260 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:49:43.261 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:49:43.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:49:43.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:49:43.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:49:43.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:49:43.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:49:43.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:49:43.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:49:43.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:49:43.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:49:43.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:49:43.263 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:49:43.263 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/1 2023-01-25T04:49:43.263 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:49:43.264 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=4faba224-0395-4407-bf35-fdcf57d27083 2023-01-25T04:49:43.264 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd1 4faba224-0395-4407-bf35-fdcf57d27083' 2023-01-25T04:49:43.264 INFO:tasks.workunit.client.0.smithi082.stdout:add osd1 4faba224-0395-4407-bf35-fdcf57d27083 2023-01-25T04:49:43.265 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:49:43.276 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQDntNBjWSBoEBAA8oWrSRsYpTOF4zHk3i7fNA== 2023-01-25T04:49:43.276 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQDntNBjWSBoEBAA8oWrSRsYpTOF4zHk3i7fNA=="}' 2023-01-25T04:49:43.277 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 4faba224-0395-4407-bf35-fdcf57d27083 -i td/crush-choose-args/1/new.json 2023-01-25T04:49:43.840 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:49:43.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/1/new.json 2023-01-25T04:49:43.853 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDntNBjWSBoEBAA8oWrSRsYpTOF4zHk3i7fNA== --osd-uuid 4faba224-0395-4407-bf35-fdcf57d27083 2023-01-25T04:49:43.883 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:43.881+0000 7f50755175c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:43.884 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:43.883+0000 7f50755175c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:43.885 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:43.884+0000 7f50755175c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:43.885 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:43.884+0000 7f50755175c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:49:43.886 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:43.885+0000 7f50755175c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:49:43.886 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:43.885+0000 7f50755175c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:49:43.959 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:43.958+0000 7f50755175c0 -1 bluestore(td/crush-choose-args/1) _read_fsid unparsable uuid 2023-01-25T04:49:49.797 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/1/keyring 2023-01-25T04:49:49.797 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:49:49.798 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd1 key to auth repository 2023-01-25T04:49:49.799 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd1 key to auth repository 2023-01-25T04:49:49.799 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:49:50.427 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.1 2023-01-25T04:49:50.428 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.1 2023-01-25T04:49:50.429 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:49:50.429 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:49:50.429 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:49:50.429 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:49:50.455 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:50.454+0000 7ff59bbc25c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:50.476 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:50.475+0000 7ff59bbc25c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:50.477 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:50.476+0000 7ff59bbc25c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:49:50.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 1 2023-01-25T04:49:50.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:49:50.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=1 2023-01-25T04:49:50.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:49:50.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:49:50.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:50.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:49:50.892 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:49:50.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:50.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:49:50.998 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:50.998+0000 7ff59bbc25c0 -1 Falling back to public interface 2023-01-25T04:49:51.367 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:52.369 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:52.369 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:52.369 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:49:52.370 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:49:52.370 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:52.370 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:49:52.876 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:53.354 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:49:53.354+0000 7ff59bbc25c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:49:53.877 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:53.879 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:53.879 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:49:53.879 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:49:53.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:53.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:49:54.448 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:55.449 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:55.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:55.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:49:55.450 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:49:55.451 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:55.451 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:49:56.039 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:57.040 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:57.041 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:57.041 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:49:57.041 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:49:57.042 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:57.042 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:49:57.555 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:49:58.556 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:49:58.557 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:49:58.557 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:49:58.558 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:49:58.558 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:49:58.558 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:49:59.153 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:00.154 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:00.154 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:00.155 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:50:00.155 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:50:00.156 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:00.156 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:00.684 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:01.686 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:01.686 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:01.686 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:50:01.687 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:50:01.687 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:01.687 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:02.272 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:03.273 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:03.273 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:03.274 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:50:03.274 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:50:03.274 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:03.275 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:03.812 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:04.814 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:04.814 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:04.814 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:50:04.815 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:50:04.815 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:04.816 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:05.471 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:06.472 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:06.473 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:06.473 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:50:06.473 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:50:06.474 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:06.474 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:06.941 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:07.943 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:07.943 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:07.943 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:50:07.944 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:50:07.944 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:07.944 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:08.886 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:09.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:09.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:09.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:50:09.889 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:50:09.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:09.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:10.716 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:11.717 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:11.718 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:11.718 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:50:11.719 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:50:11.720 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:11.720 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:12.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:13.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:13.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:13.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:50:13.618 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:50:13.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:13.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:14.538 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:15.539 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:15.540 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:15.540 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:50:15.540 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:50:15.541 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:15.541 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:50:15.986 INFO:tasks.workunit.client.0.smithi082.stdout:osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/102548,v1:127.0.0.1:6811/102548] [v2:127.0.0.1:6812/102548,v1:127.0.0.1:6813/102548] exists,up 4faba224-0395-4407-bf35-fdcf57d27083 2023-01-25T04:50:15.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:50:15.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:50:15.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:50:15.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:87: TEST_choose_args_update: ceph osd crush tree 2023-01-25T04:50:16.441 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT 0 TYPE NAME 2023-01-25T04:50:16.442 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:50:16.442 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 5.00000 host HOST 2023-01-25T04:50:16.442 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:50:16.442 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 3.00000 osd.1 2023-01-25T04:50:16.455 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:88: TEST_choose_args_update: ceph osd getcrushmap 2023-01-25T04:50:16.888 INFO:tasks.workunit.client.0.smithi082.stderr:5 2023-01-25T04:50:16.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:89: TEST_choose_args_update: crushtool -d td/crush-choose-args/map-one-more -o td/crush-choose-args/map-one-more.txt 2023-01-25T04:50:16.915 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:90: TEST_choose_args_update: cat td/crush-choose-args/map-one-more.txt 2023-01-25T04:50:16.916 INFO:tasks.workunit.client.0.smithi082.stdout:# begin crush map 2023-01-25T04:50:16.916 INFO:tasks.workunit.client.0.smithi082.stdout:tunable choose_local_tries 0 2023-01-25T04:50:16.916 INFO:tasks.workunit.client.0.smithi082.stdout:tunable choose_local_fallback_tries 0 2023-01-25T04:50:16.916 INFO:tasks.workunit.client.0.smithi082.stdout:tunable choose_total_tries 50 2023-01-25T04:50:16.917 INFO:tasks.workunit.client.0.smithi082.stdout:tunable chooseleaf_descend_once 1 2023-01-25T04:50:16.917 INFO:tasks.workunit.client.0.smithi082.stdout:tunable chooseleaf_vary_r 1 2023-01-25T04:50:16.917 INFO:tasks.workunit.client.0.smithi082.stdout:tunable chooseleaf_stable 1 2023-01-25T04:50:16.917 INFO:tasks.workunit.client.0.smithi082.stdout:tunable straw_calc_version 1 2023-01-25T04:50:16.917 INFO:tasks.workunit.client.0.smithi082.stdout:tunable allowed_bucket_algs 54 2023-01-25T04:50:16.918 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:50:16.918 INFO:tasks.workunit.client.0.smithi082.stdout:# devices 2023-01-25T04:50:16.918 INFO:tasks.workunit.client.0.smithi082.stdout:device 0 osd.0 2023-01-25T04:50:16.918 INFO:tasks.workunit.client.0.smithi082.stdout:device 1 osd.1 2023-01-25T04:50:16.918 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:50:16.919 INFO:tasks.workunit.client.0.smithi082.stdout:# types 2023-01-25T04:50:16.919 INFO:tasks.workunit.client.0.smithi082.stdout:type 0 osd 2023-01-25T04:50:16.919 INFO:tasks.workunit.client.0.smithi082.stdout:type 1 host 2023-01-25T04:50:16.919 INFO:tasks.workunit.client.0.smithi082.stdout:type 2 chassis 2023-01-25T04:50:16.919 INFO:tasks.workunit.client.0.smithi082.stdout:type 3 rack 2023-01-25T04:50:16.920 INFO:tasks.workunit.client.0.smithi082.stdout:type 4 row 2023-01-25T04:50:16.920 INFO:tasks.workunit.client.0.smithi082.stdout:type 5 pdu 2023-01-25T04:50:16.920 INFO:tasks.workunit.client.0.smithi082.stdout:type 6 pod 2023-01-25T04:50:16.920 INFO:tasks.workunit.client.0.smithi082.stdout:type 7 room 2023-01-25T04:50:16.921 INFO:tasks.workunit.client.0.smithi082.stdout:type 8 datacenter 2023-01-25T04:50:16.921 INFO:tasks.workunit.client.0.smithi082.stdout:type 9 zone 2023-01-25T04:50:16.921 INFO:tasks.workunit.client.0.smithi082.stdout:type 10 region 2023-01-25T04:50:16.921 INFO:tasks.workunit.client.0.smithi082.stdout:type 11 root 2023-01-25T04:50:16.921 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:50:16.922 INFO:tasks.workunit.client.0.smithi082.stdout:# buckets 2023-01-25T04:50:16.922 INFO:tasks.workunit.client.0.smithi082.stdout:host HOST { 2023-01-25T04:50:16.922 INFO:tasks.workunit.client.0.smithi082.stdout: id -2 # do not change unnecessarily 2023-01-25T04:50:16.922 INFO:tasks.workunit.client.0.smithi082.stdout: # weight 6.00000 2023-01-25T04:50:16.922 INFO:tasks.workunit.client.0.smithi082.stdout: alg straw2 2023-01-25T04:50:16.923 INFO:tasks.workunit.client.0.smithi082.stdout: hash 0 # rjenkins1 2023-01-25T04:50:16.923 INFO:tasks.workunit.client.0.smithi082.stdout: item osd.0 weight 3.00000 2023-01-25T04:50:16.923 INFO:tasks.workunit.client.0.smithi082.stdout: item osd.1 weight 3.00000 2023-01-25T04:50:16.923 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:50:16.923 INFO:tasks.workunit.client.0.smithi082.stdout:root default { 2023-01-25T04:50:16.923 INFO:tasks.workunit.client.0.smithi082.stdout: id -1 # do not change unnecessarily 2023-01-25T04:50:16.924 INFO:tasks.workunit.client.0.smithi082.stdout: # weight 6.00000 2023-01-25T04:50:16.924 INFO:tasks.workunit.client.0.smithi082.stdout: alg straw2 2023-01-25T04:50:16.926 INFO:tasks.workunit.client.0.smithi082.stdout: hash 0 # rjenkins1 2023-01-25T04:50:16.928 INFO:tasks.workunit.client.0.smithi082.stdout: item HOST weight 6.00000 2023-01-25T04:50:16.928 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:50:16.928 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:50:16.929 INFO:tasks.workunit.client.0.smithi082.stdout:# rules 2023-01-25T04:50:16.929 INFO:tasks.workunit.client.0.smithi082.stdout:rule replicated_rule { 2023-01-25T04:50:16.929 INFO:tasks.workunit.client.0.smithi082.stdout: id 0 2023-01-25T04:50:16.929 INFO:tasks.workunit.client.0.smithi082.stdout: type replicated 2023-01-25T04:50:16.930 INFO:tasks.workunit.client.0.smithi082.stdout: step take default 2023-01-25T04:50:16.930 INFO:tasks.workunit.client.0.smithi082.stdout: step choose firstn 0 type osd 2023-01-25T04:50:16.930 INFO:tasks.workunit.client.0.smithi082.stdout: step emit 2023-01-25T04:50:16.930 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:50:16.930 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:50:16.930 INFO:tasks.workunit.client.0.smithi082.stdout:# choose_args 2023-01-25T04:50:16.931 INFO:tasks.workunit.client.0.smithi082.stdout:choose_args 0 { 2023-01-25T04:50:16.931 INFO:tasks.workunit.client.0.smithi082.stdout: { 2023-01-25T04:50:16.931 INFO:tasks.workunit.client.0.smithi082.stdout: bucket_id -1 2023-01-25T04:50:16.931 INFO:tasks.workunit.client.0.smithi082.stdout: weight_set [ 2023-01-25T04:50:16.931 INFO:tasks.workunit.client.0.smithi082.stdout: [ 5.00000 ] 2023-01-25T04:50:16.932 INFO:tasks.workunit.client.0.smithi082.stdout: [ 5.00000 ] 2023-01-25T04:50:16.932 INFO:tasks.workunit.client.0.smithi082.stdout: ] 2023-01-25T04:50:16.932 INFO:tasks.workunit.client.0.smithi082.stdout: ids [ -10 ] 2023-01-25T04:50:16.932 INFO:tasks.workunit.client.0.smithi082.stdout: } 2023-01-25T04:50:16.932 INFO:tasks.workunit.client.0.smithi082.stdout: { 2023-01-25T04:50:16.933 INFO:tasks.workunit.client.0.smithi082.stdout: bucket_id -2 2023-01-25T04:50:16.933 INFO:tasks.workunit.client.0.smithi082.stdout: weight_set [ 2023-01-25T04:50:16.933 INFO:tasks.workunit.client.0.smithi082.stdout: [ 2.00000 3.00000 ] 2023-01-25T04:50:16.933 INFO:tasks.workunit.client.0.smithi082.stdout: [ 2.00000 3.00000 ] 2023-01-25T04:50:16.933 INFO:tasks.workunit.client.0.smithi082.stdout: ] 2023-01-25T04:50:16.934 INFO:tasks.workunit.client.0.smithi082.stdout: ids [ -20 1 ] 2023-01-25T04:50:16.934 INFO:tasks.workunit.client.0.smithi082.stdout: } 2023-01-25T04:50:16.934 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:50:16.934 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:50:16.934 INFO:tasks.workunit.client.0.smithi082.stdout:# end crush map 2023-01-25T04:50:16.935 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:91: TEST_choose_args_update: diff -u td/crush-choose-args/map-one-more.txt /home/ubuntu/cephtest/clone.client.0/src/test/crush/crush-choose-args-expected-one-more-3.txt 2023-01-25T04:50:16.935 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:93: TEST_choose_args_update: destroy_osd td/crush-choose-args 1 2023-01-25T04:50:16.936 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:783: destroy_osd: local dir=td/crush-choose-args 2023-01-25T04:50:16.936 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:784: destroy_osd: local id=1 2023-01-25T04:50:16.936 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:786: destroy_osd: ceph osd out osd.1 2023-01-25T04:50:17.516 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 is already out. 2023-01-25T04:50:17.525 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:787: destroy_osd: kill_daemons td/crush-choose-args TERM osd.1 2023-01-25T04:50:17.526 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:50:17.526 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:50:17.527 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:50:17.527 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:50:17.527 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:50:17.833 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:50:17.833 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:788: destroy_osd: ceph osd down osd.1 2023-01-25T04:50:18.298 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 is already down. 2023-01-25T04:50:18.306 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:789: destroy_osd: ceph osd purge osd.1 --yes-i-really-mean-it 2023-01-25T04:50:18.852 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 does not exist 2023-01-25T04:50:18.863 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:790: destroy_osd: teardown td/crush-choose-args/1 2023-01-25T04:50:18.864 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args/1 2023-01-25T04:50:18.864 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:50:18.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args/1 KILL 2023-01-25T04:50:18.865 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:50:18.865 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:50:18.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:50:18.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:50:18.866 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:50:18.867 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:50:18.867 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:50:18.867 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:50:18.867 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:50:18.868 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:50:18.868 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:50:18.868 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:50:18.869 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:50:18.869 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:50:18.869 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:50:18.869 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:50:18.870 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:50:18.870 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:50:18.871 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args/1 2023-01-25T04:50:18.873 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:50:18.874 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:18.874 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:18.874 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:50:18.875 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:50:18.875 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:50:18.875 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:791: destroy_osd: rm -fr td/crush-choose-args/1 2023-01-25T04:50:18.875 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:94: TEST_choose_args_update: ceph osd crush tree 2023-01-25T04:50:19.355 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT 0 TYPE NAME 2023-01-25T04:50:19.355 INFO:tasks.workunit.client.0.smithi082.stdout:-1 3.00000 root default 2023-01-25T04:50:19.355 INFO:tasks.workunit.client.0.smithi082.stdout:-2 3.00000 2.00000 host HOST 2023-01-25T04:50:19.355 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:50:19.364 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:95: TEST_choose_args_update: ceph osd getcrushmap 2023-01-25T04:50:19.847 INFO:tasks.workunit.client.0.smithi082.stderr:6 2023-01-25T04:50:19.856 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:96: TEST_choose_args_update: crushtool -d td/crush-choose-args/map-one-less -o td/crush-choose-args/map-one-less.txt 2023-01-25T04:50:19.875 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:97: TEST_choose_args_update: diff -u td/crush-choose-args/map-one-less.txt td/crush-choose-args/map.txt 2023-01-25T04:50:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:41: run: teardown td/crush-choose-args 2023-01-25T04:50:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:50:19.877 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:50:19.878 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:50:19.878 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:50:19.878 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:50:19.878 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:50:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:50:19.879 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:50:19.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:50:19.984 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:50:19.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:50:19.985 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:50:19.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:50:19.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:50:19.986 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:50:19.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:50:19.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:50:19.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:50:19.988 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:50:19.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:50:19.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:50:19.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:50:19.996 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:50:19.996 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:19.996 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:19.996 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:50:19.998 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:50:19.999 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:50:19.999 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:38: run: for func in $funcs 2023-01-25T04:50:19.999 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:39: run: setup td/crush-choose-args 2023-01-25T04:50:19.999 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/crush-choose-args 2023-01-25T04:50:19.999 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/crush-choose-args 2023-01-25T04:50:20.000 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:50:20.000 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:50:20.000 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:50:20.000 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:50:20.001 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:50:20.001 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:50:20.001 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:50:20.002 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:50:20.002 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:50:20.002 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:50:20.003 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:50:20.004 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:50:20.004 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:50:20.004 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:50:20.004 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:50:20.004 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:50:20.005 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:50:20.005 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:50:20.005 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:50:20.005 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:50:20.006 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:50:20.007 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:50:20.007 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:50:20.007 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:20.007 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:20.007 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:50:20.008 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:50:20.008 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:50:20.008 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/crush-choose-args 2023-01-25T04:50:20.010 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2023-01-25T04:50:20.010 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:20.010 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:20.010 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.99479 2023-01-25T04:50:20.011 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2023-01-25T04:50:20.011 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2023-01-25T04:50:20.011 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2023-01-25T04:50:20.011 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/crush-choose-args 1' TERM HUP INT 2023-01-25T04:50:20.011 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:40: run: TEST_move_bucket td/crush-choose-args 2023-01-25T04:50:20.012 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:195: TEST_move_bucket: local dir=td/crush-choose-args 2023-01-25T04:50:20.012 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:197: TEST_move_bucket: run_mon td/crush-choose-args a 2023-01-25T04:50:20.012 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/crush-choose-args 2023-01-25T04:50:20.012 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2023-01-25T04:50:20.012 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2023-01-25T04:50:20.012 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2023-01-25T04:50:20.013 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/crush-choose-args/a 2023-01-25T04:50:20.013 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/crush-choose-args/a --run-dir=td/crush-choose-args 2023-01-25T04:50:20.400 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2023-01-25T04:50:20.400 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:50:20.401 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:50:20.401 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:50:20.401 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:20.401 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:20.401 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:50:20.402 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/crush-choose-args/a '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --mon-cluster-log-file=td/crush-choose-args/log --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2023-01-25T04:50:20.660 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2023-01-25T04:50:20.662 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2023-01-25T04:50:20.662 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:50:20.662 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:50:20.662 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=fsid 2023-01-25T04:50:20.662 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .fsid 2023-01-25T04:50:20.663 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:50:20.663 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:50:20.663 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:50:20.663 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:50:20.663 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:20.664 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:20.664 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:50:20.664 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:50:20.664 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get fsid 2023-01-25T04:50:20.763 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2023-01-25T04:50:20.764 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:50:20.764 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:50:20.764 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=mon_host 2023-01-25T04:50:20.764 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .mon_host 2023-01-25T04:50:20.765 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:50:20.765 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:50:20.766 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:50:20.766 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:50:20.766 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:20.767 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:20.767 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:50:20.768 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:50:20.768 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get mon_host 2023-01-25T04:50:20.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:198: TEST_move_bucket: run_mgr td/crush-choose-args x 2023-01-25T04:50:20.866 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/crush-choose-args 2023-01-25T04:50:20.866 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2023-01-25T04:50:20.866 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2023-01-25T04:50:20.867 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2023-01-25T04:50:20.867 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/crush-choose-args/x 2023-01-25T04:50:20.867 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2023-01-25T04:50:21.749 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2023-01-25T04:50:21.750 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:50:21.750 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:50:21.750 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:50:21.750 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:21.751 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:21.751 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:50:21.751 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:50:21.752 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/crush-choose-args/x '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:50:21.783 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:199: TEST_move_bucket: run_osd td/crush-choose-args 0 2023-01-25T04:50:21.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:50:21.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:50:21.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2023-01-25T04:50:21.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:50:21.785 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/0 2023-01-25T04:50:21.785 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false ' 2023-01-25T04:50:21.785 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:50:21.785 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:50:21.785 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:50:21.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/0' 2023-01-25T04:50:21.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/0/journal' 2023-01-25T04:50:21.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:50:21.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:50:21.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:50:21.787 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:50:21.787 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:50:21.787 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:50:21.787 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:50:21.787 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:21.788 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:21.788 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:50:21.788 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:50:21.788 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:50:21.788 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:50:21.789 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:50:21.789 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:50:21.789 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:50:21.789 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:50:21.789 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:50:21.790 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:50:21.790 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:50:21.790 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:50:21.790 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/0 2023-01-25T04:50:21.790 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:50:21.790 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=e4deee64-204d-4de1-b552-62adb3e69cad 2023-01-25T04:50:21.791 INFO:tasks.workunit.client.0.smithi082.stdout:add osd0 e4deee64-204d-4de1-b552-62adb3e69cad 2023-01-25T04:50:21.791 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd0 e4deee64-204d-4de1-b552-62adb3e69cad' 2023-01-25T04:50:21.792 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:50:21.804 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQANtdBjh7TULxAAgpKEa07Zk2gk3xL+8EO2zA== 2023-01-25T04:50:21.804 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQANtdBjh7TULxAAgpKEa07Zk2gk3xL+8EO2zA=="}' 2023-01-25T04:50:21.805 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new e4deee64-204d-4de1-b552-62adb3e69cad -i td/crush-choose-args/0/new.json 2023-01-25T04:50:22.163 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:50:22.174 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/0/new.json 2023-01-25T04:50:22.175 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQANtdBjh7TULxAAgpKEa07Zk2gk3xL+8EO2zA== --osd-uuid e4deee64-204d-4de1-b552-62adb3e69cad 2023-01-25T04:50:22.205 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:22.203+0000 7fb3923f35c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:22.211 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:22.210+0000 7fb3923f35c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:22.212 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:22.211+0000 7fb3923f35c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:22.213 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:22.211+0000 7fb3923f35c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:50:22.213 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:22.211+0000 7fb3923f35c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:50:22.214 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:22.211+0000 7fb3923f35c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:50:22.252 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:22.250+0000 7fb3923f35c0 -1 bluestore(td/crush-choose-args/0) _read_fsid unparsable uuid 2023-01-25T04:50:27.555 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/0/keyring 2023-01-25T04:50:27.555 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:50:27.556 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd0 key to auth repository 2023-01-25T04:50:27.557 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd0 key to auth repository 2023-01-25T04:50:27.557 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:50:27.899 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.0 2023-01-25T04:50:27.899 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.0 2023-01-25T04:50:27.900 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:50:27.900 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:50:27.900 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:50:27.901 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:50:27.926 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:27.924+0000 7f2ee9f1e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:27.928 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:27.926+0000 7f2ee9f1e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:27.929 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:27.927+0000 7f2ee9f1e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:28.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 0 2023-01-25T04:50:28.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:50:28.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=0 2023-01-25T04:50:28.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:50:28.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:50:28.364 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:28.364 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:50:28.364 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:50:28.365 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:28.365 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:28.457 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:28.455+0000 7f2ee9f1e5c0 -1 Falling back to public interface 2023-01-25T04:50:28.849 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:29.850 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:29.851 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:29.851 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:50:29.851 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:50:29.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:29.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:30.303 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:30.908 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:30.905+0000 7f2ee9f1e5c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:50:31.305 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:31.305 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:31.306 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:50:31.306 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:50:31.306 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:31.307 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:31.753 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:32.754 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:32.754 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:32.754 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:50:32.755 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:50:32.755 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:32.755 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:33.207 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:34.208 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:34.209 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:34.209 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:50:34.209 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:50:34.211 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:34.211 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:34.716 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:35.717 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:35.717 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:35.717 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:50:35.718 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:50:35.718 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:35.718 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:36.204 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:37.206 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:37.206 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:37.207 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:50:37.207 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:50:37.207 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:37.208 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:37.713 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:38.715 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:38.715 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:38.715 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:50:38.716 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:50:38.716 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:38.717 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:39.163 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:40.164 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:40.165 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:40.165 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:50:40.166 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:50:40.166 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:40.166 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:40.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:41.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:41.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:41.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:50:41.609 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:50:41.610 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:41.610 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:42.141 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:43.142 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:43.142 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:43.143 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:50:43.143 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:50:43.143 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:43.144 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:44.172 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:45.174 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:45.174 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:45.174 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:50:45.175 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:50:45.176 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:45.176 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:46.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:47.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:47.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:47.087 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:50:47.087 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:50:47.087 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:47.088 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:47.799 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:48.800 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:48.801 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:48.801 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:50:48.801 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:50:48.802 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:48.802 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:49.597 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:50.599 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:50.600 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:50.600 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:50:50.601 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:50:50.601 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:50.602 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:51.515 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:50:52.516 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:50:52.517 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:50:52.517 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:50:52.518 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:50:52.518 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:50:52.518 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:50:52.977 INFO:tasks.workunit.client.0.smithi082.stdout:osd.0 up in weight 1 up_from 4 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/104776,v1:127.0.0.1:6803/104776] [v2:127.0.0.1:6804/104776,v1:127.0.0.1:6805/104776] exists,up e4deee64-204d-4de1-b552-62adb3e69cad 2023-01-25T04:50:52.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:50:52.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:50:52.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:50:52.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:200: TEST_move_bucket: run_osd td/crush-choose-args 1 2023-01-25T04:50:52.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:50:52.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:50:52.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2023-01-25T04:50:52.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:50:52.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/1 2023-01-25T04:50:52.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false ' 2023-01-25T04:50:52.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:50:52.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:50:52.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:50:52.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/1' 2023-01-25T04:50:52.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/1/journal' 2023-01-25T04:50:52.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:50:52.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:50:52.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:50:52.984 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:50:52.984 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:50:52.985 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:50:52.985 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:50:52.985 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:50:52.985 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:50:52.986 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:50:52.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:50:52.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:50:52.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:50:52.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:50:52.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:50:52.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:50:52.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:50:52.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:50:52.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:50:52.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:50:52.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:50:52.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/1 2023-01-25T04:50:52.989 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:50:52.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=9e58b0f6-4c4a-4de5-a59a-cd10fc6e0db0 2023-01-25T04:50:52.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd1 9e58b0f6-4c4a-4de5-a59a-cd10fc6e0db0' 2023-01-25T04:50:52.990 INFO:tasks.workunit.client.0.smithi082.stdout:add osd1 9e58b0f6-4c4a-4de5-a59a-cd10fc6e0db0 2023-01-25T04:50:52.990 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:50:52.997 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQAstdBjPq5dOxAAXDKqawm0a1fv/CiANT1xUQ== 2023-01-25T04:50:52.997 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQAstdBjPq5dOxAAXDKqawm0a1fv/CiANT1xUQ=="}' 2023-01-25T04:50:52.998 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 9e58b0f6-4c4a-4de5-a59a-cd10fc6e0db0 -i td/crush-choose-args/1/new.json 2023-01-25T04:50:53.597 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:50:53.610 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/1/new.json 2023-01-25T04:50:53.611 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAstdBjPq5dOxAAXDKqawm0a1fv/CiANT1xUQ== --osd-uuid 9e58b0f6-4c4a-4de5-a59a-cd10fc6e0db0 2023-01-25T04:50:53.640 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:53.639+0000 7f71b0dbc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:53.642 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:53.641+0000 7f71b0dbc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:53.643 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:53.642+0000 7f71b0dbc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:53.643 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:53.642+0000 7f71b0dbc5c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:50:53.644 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:53.642+0000 7f71b0dbc5c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:50:53.644 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:53.642+0000 7f71b0dbc5c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:50:53.714 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:53.713+0000 7f71b0dbc5c0 -1 bluestore(td/crush-choose-args/1) _read_fsid unparsable uuid 2023-01-25T04:50:59.311 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/1/keyring 2023-01-25T04:50:59.311 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:50:59.312 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd1 key to auth repository 2023-01-25T04:50:59.313 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd1 key to auth repository 2023-01-25T04:50:59.313 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:50:59.912 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.1 2023-01-25T04:50:59.913 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.1 2023-01-25T04:50:59.914 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:50:59.914 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:50:59.914 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:50:59.914 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:50:59.940 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:59.938+0000 7f2e9efb45c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:59.942 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:59.940+0000 7f2e9efb45c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:50:59.943 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:50:59.941+0000 7f2e9efb45c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:51:00.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 1 2023-01-25T04:51:00.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:51:00.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=1 2023-01-25T04:51:00.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:51:00.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:51:00.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:00.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:51:00.362 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:51:00.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:00.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:00.479 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:00.478+0000 7f2e9efb45c0 -1 Falling back to public interface 2023-01-25T04:51:00.811 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:01.812 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:01.812 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:01.812 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:51:01.813 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:51:01.813 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:01.813 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:02.288 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:02.933 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:02.931+0000 7f2e9efb45c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:51:03.290 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:03.290 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:03.290 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:51:03.290 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:51:03.291 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:03.292 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:03.803 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:04.805 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:04.806 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:04.806 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:51:04.806 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:51:04.807 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:04.807 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:05.252 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:06.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:06.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:06.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:51:06.257 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:51:06.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:06.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:06.712 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:07.713 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:07.714 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:07.714 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:51:07.715 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:51:07.715 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:07.715 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:08.211 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:09.213 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:09.213 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:09.213 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:51:09.214 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:51:09.214 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:09.214 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:09.657 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:10.659 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:10.659 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:10.660 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:51:10.660 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:51:10.660 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:10.661 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:11.103 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:12.105 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:12.105 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:12.105 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:51:12.108 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:51:12.109 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:12.109 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:12.615 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:13.616 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:13.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:13.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:51:13.617 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:51:13.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:13.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:14.512 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:15.513 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:15.513 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:15.513 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:51:15.514 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:51:15.514 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:15.515 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:16.389 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:17.391 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:17.391 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:17.392 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:51:17.392 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:51:17.393 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:17.393 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:18.024 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:19.025 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:51:19.025 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:19.026 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:19.026 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:51:19.026 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:19.026 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:19.969 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:20.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:20.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:20.974 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:51:20.974 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:51:20.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:20.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:21.792 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:22.793 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:22.793 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:22.794 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:51:22.794 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:51:22.794 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:22.795 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:23.751 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:24.750 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:24.751 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:24.751 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:51:24.751 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:51:24.752 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:24.752 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:51:25.233 INFO:tasks.workunit.client.0.smithi082.stdout:osd.1 up in weight 1 up_from 8 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/106491,v1:127.0.0.1:6811/106491] [v2:127.0.0.1:6812/106491,v1:127.0.0.1:6813/106491] exists,up 9e58b0f6-4c4a-4de5-a59a-cd10fc6e0db0 2023-01-25T04:51:25.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:51:25.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:51:25.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:51:25.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:202: TEST_move_bucket: ceph osd crush weight-set create-compat 2023-01-25T04:51:25.814 INFO:tasks.workunit.client.0.smithi082.stderr:compat weight-set already created 2023-01-25T04:51:25.823 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:203: TEST_move_bucket: ceph osd crush weight-set reweight-compat osd.0 2 2023-01-25T04:51:26.500 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:204: TEST_move_bucket: ceph osd crush weight-set reweight-compat osd.1 2 2023-01-25T04:51:27.697 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:205: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:28.205 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:51:28.205 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:51:28.205 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 4.00000 host HOST 2023-01-25T04:51:28.205 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:51:28.206 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 2.00000 osd.1 2023-01-25T04:51:28.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:206: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:28.218 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:206: TEST_move_bucket: grep HOST 2023-01-25T04:51:28.218 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:206: TEST_move_bucket: grep '6.00000 4.00000' 2023-01-25T04:51:28.693 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 4.00000 host HOST 2023-01-25T04:51:28.693 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:209: TEST_move_bucket: ceph osd crush add-bucket RACK rack root=default 2023-01-25T04:51:29.301 INFO:tasks.workunit.client.0.smithi082.stderr:bucket 'RACK' already exists 2023-01-25T04:51:29.310 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:210: TEST_move_bucket: ceph osd crush move HOST rack=RACK 2023-01-25T04:51:29.911 INFO:tasks.workunit.client.0.smithi082.stderr:no need to move item id -2 name 'HOST' to location {rack=RACK} in crush map 2023-01-25T04:51:29.921 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:211: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:30.376 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:51:30.377 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:51:30.377 INFO:tasks.workunit.client.0.smithi082.stdout:-3 6.00000 4.00000 rack RACK 2023-01-25T04:51:30.377 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 4.00000 host HOST 2023-01-25T04:51:30.377 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:51:30.377 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 2.00000 osd.1 2023-01-25T04:51:30.389 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:212: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:30.390 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:212: TEST_move_bucket: grep HOST 2023-01-25T04:51:30.390 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:212: TEST_move_bucket: grep '6.00000 4.00000' 2023-01-25T04:51:30.890 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 4.00000 host HOST 2023-01-25T04:51:30.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:213: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:30.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:213: TEST_move_bucket: grep RACK 2023-01-25T04:51:30.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:213: TEST_move_bucket: grep '6.00000 4.00000' 2023-01-25T04:51:31.369 INFO:tasks.workunit.client.0.smithi082.stdout:-3 6.00000 4.00000 rack RACK 2023-01-25T04:51:31.369 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:216: TEST_move_bucket: ceph osd crush weight-set reweight-compat osd.0 1 2023-01-25T04:51:32.244 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:217: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:32.793 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:51:32.794 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:51:32.794 INFO:tasks.workunit.client.0.smithi082.stdout:-3 6.00000 3.00000 rack RACK 2023-01-25T04:51:32.794 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 3.00000 host HOST 2023-01-25T04:51:32.794 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 1.00000 osd.0 2023-01-25T04:51:32.795 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 2.00000 osd.1 2023-01-25T04:51:32.805 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:218: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:32.806 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:218: TEST_move_bucket: grep HOST 2023-01-25T04:51:32.806 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:218: TEST_move_bucket: grep '6.00000 3.00000' 2023-01-25T04:51:33.306 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 3.00000 host HOST 2023-01-25T04:51:33.306 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:219: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:33.307 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:219: TEST_move_bucket: grep RACK 2023-01-25T04:51:33.307 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:219: TEST_move_bucket: grep '6.00000 3.00000' 2023-01-25T04:51:33.816 INFO:tasks.workunit.client.0.smithi082.stdout:-3 6.00000 3.00000 rack RACK 2023-01-25T04:51:33.816 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:222: TEST_move_bucket: ceph config set mon osd_crush_update_weight_set true 2023-01-25T04:51:34.300 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:223: TEST_move_bucket: ceph osd crush add-bucket FOO host root=default 2023-01-25T04:51:34.850 INFO:tasks.workunit.client.0.smithi082.stderr:bucket 'FOO' already exists 2023-01-25T04:51:34.860 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:224: TEST_move_bucket: ceph osd crush move osd.0 host=FOO 2023-01-25T04:51:35.435 INFO:tasks.workunit.client.0.smithi082.stderr:no need to move item id 0 name 'osd.0' to location {host=FOO} in crush map 2023-01-25T04:51:35.444 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:225: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:35.924 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:51:35.924 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:51:35.924 INFO:tasks.workunit.client.0.smithi082.stdout:-4 3.00000 3.00000 host FOO 2023-01-25T04:51:35.925 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 3.00000 osd.0 2023-01-25T04:51:35.925 INFO:tasks.workunit.client.0.smithi082.stdout:-3 3.00000 2.00000 rack RACK 2023-01-25T04:51:35.925 INFO:tasks.workunit.client.0.smithi082.stdout:-2 3.00000 2.00000 host HOST 2023-01-25T04:51:35.925 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 2.00000 osd.1 2023-01-25T04:51:35.936 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:226: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:35.937 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:226: TEST_move_bucket: grep osd.0 2023-01-25T04:51:35.937 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:226: TEST_move_bucket: grep '3.00000 3.00000' 2023-01-25T04:51:36.422 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 3.00000 osd.0 2023-01-25T04:51:36.423 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:227: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:36.423 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:227: TEST_move_bucket: grep HOST 2023-01-25T04:51:36.423 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:227: TEST_move_bucket: grep '3.00000 2.00000' 2023-01-25T04:51:36.905 INFO:tasks.workunit.client.0.smithi082.stdout:-2 3.00000 2.00000 host HOST 2023-01-25T04:51:36.906 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:228: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:36.906 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:228: TEST_move_bucket: grep RACK 2023-01-25T04:51:36.906 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:228: TEST_move_bucket: grep '3.00000 2.00000' 2023-01-25T04:51:37.425 INFO:tasks.workunit.client.0.smithi082.stdout:-3 3.00000 2.00000 rack RACK 2023-01-25T04:51:37.425 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:231: TEST_move_bucket: ceph config set mon osd_crush_update_weight_set false 2023-01-25T04:51:37.951 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:232: TEST_move_bucket: ceph osd crush move osd.1 host=FOO 2023-01-25T04:51:38.518 INFO:tasks.workunit.client.0.smithi082.stderr:no need to move item id 1 name 'osd.1' to location {host=FOO} in crush map 2023-01-25T04:51:38.527 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:233: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:38.966 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:51:38.967 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:51:38.967 INFO:tasks.workunit.client.0.smithi082.stdout:-4 6.00000 3.00000 host FOO 2023-01-25T04:51:38.967 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 3.00000 osd.0 2023-01-25T04:51:38.967 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 0 osd.1 2023-01-25T04:51:38.967 INFO:tasks.workunit.client.0.smithi082.stdout:-3 0 0 rack RACK 2023-01-25T04:51:38.968 INFO:tasks.workunit.client.0.smithi082.stdout:-2 0 0 host HOST 2023-01-25T04:51:38.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:234: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:38.980 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:234: TEST_move_bucket: grep osd.0 2023-01-25T04:51:38.980 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:234: TEST_move_bucket: grep '3.00000 3.00000' 2023-01-25T04:51:39.438 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 3.00000 osd.0 2023-01-25T04:51:39.439 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:235: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:39.439 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:235: TEST_move_bucket: grep osd.1 2023-01-25T04:51:39.439 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:235: TEST_move_bucket: grep '3.00000 0' 2023-01-25T04:51:39.945 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 0 osd.1 2023-01-25T04:51:39.946 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:236: TEST_move_bucket: ceph osd crush tree 2023-01-25T04:51:39.946 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:236: TEST_move_bucket: grep FOO 2023-01-25T04:51:39.946 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:236: TEST_move_bucket: grep '6.00000 3.00000' 2023-01-25T04:51:40.465 INFO:tasks.workunit.client.0.smithi082.stdout:-4 6.00000 3.00000 host FOO 2023-01-25T04:51:40.467 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:41: run: teardown td/crush-choose-args 2023-01-25T04:51:40.467 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:51:40.467 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:51:40.467 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:51:40.467 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:51:40.468 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:51:40.468 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:51:40.468 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:51:40.468 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:51:40.573 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:51:40.573 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:51:40.574 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:51:40.574 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:51:40.575 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:51:40.575 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:51:40.576 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:51:40.577 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:51:40.578 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:51:40.578 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:51:40.578 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:51:40.578 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:51:40.579 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:51:40.579 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:51:40.588 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:51:40.588 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:40.589 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:40.589 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:51:40.590 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:51:40.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:51:40.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:38: run: for func in $funcs 2023-01-25T04:51:40.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:39: run: setup td/crush-choose-args 2023-01-25T04:51:40.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/crush-choose-args 2023-01-25T04:51:40.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/crush-choose-args 2023-01-25T04:51:40.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:51:40.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:51:40.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:51:40.592 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:51:40.593 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:51:40.593 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:51:40.593 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:51:40.596 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:51:40.598 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:51:40.598 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:51:40.598 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:51:40.598 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:51:40.599 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:51:40.599 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:51:40.599 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:51:40.599 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:51:40.599 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:51:40.600 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:51:40.600 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:51:40.600 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:51:40.600 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:51:40.601 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:51:40.601 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:51:40.601 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:40.601 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:40.601 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:51:40.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:51:40.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:51:40.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/crush-choose-args 2023-01-25T04:51:40.606 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2023-01-25T04:51:40.606 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:40.606 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:40.606 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.99479 2023-01-25T04:51:40.606 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2023-01-25T04:51:40.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2023-01-25T04:51:40.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2023-01-25T04:51:40.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/crush-choose-args 1' TERM HUP INT 2023-01-25T04:51:40.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:40: run: TEST_no_update_weight_set td/crush-choose-args 2023-01-25T04:51:40.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:104: TEST_no_update_weight_set: local dir=td/crush-choose-args 2023-01-25T04:51:40.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:106: TEST_no_update_weight_set: ORIG_CEPH_ARGS='--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false ' 2023-01-25T04:51:40.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:107: TEST_no_update_weight_set: CEPH_ARGS+='--osd-crush-update-weight-set=false ' 2023-01-25T04:51:40.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:109: TEST_no_update_weight_set: run_mon td/crush-choose-args a 2023-01-25T04:51:40.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/crush-choose-args 2023-01-25T04:51:40.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2023-01-25T04:51:40.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2023-01-25T04:51:40.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2023-01-25T04:51:40.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/crush-choose-args/a 2023-01-25T04:51:40.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/crush-choose-args/a --run-dir=td/crush-choose-args 2023-01-25T04:51:40.943 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2023-01-25T04:51:40.943 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:51:40.944 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:51:40.944 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:51:40.944 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:40.944 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:40.945 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:51:40.945 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/crush-choose-args/a '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --mon-cluster-log-file=td/crush-choose-args/log --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2023-01-25T04:51:41.195 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2023-01-25T04:51:41.198 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2023-01-25T04:51:41.198 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:51:41.198 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:51:41.199 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=fsid 2023-01-25T04:51:41.199 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .fsid 2023-01-25T04:51:41.199 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:51:41.199 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:51:41.199 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:51:41.200 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:51:41.200 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:41.201 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:41.201 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:51:41.201 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:51:41.202 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get fsid 2023-01-25T04:51:41.299 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2023-01-25T04:51:41.300 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:51:41.300 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:51:41.300 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=mon_host 2023-01-25T04:51:41.300 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .mon_host 2023-01-25T04:51:41.301 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:51:41.301 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:51:41.301 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:51:41.301 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:51:41.301 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:41.302 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:41.302 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:51:41.302 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:51:41.302 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get mon_host 2023-01-25T04:51:41.401 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:110: TEST_no_update_weight_set: run_mgr td/crush-choose-args x 2023-01-25T04:51:41.402 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/crush-choose-args 2023-01-25T04:51:41.402 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2023-01-25T04:51:41.403 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2023-01-25T04:51:41.403 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2023-01-25T04:51:41.403 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/crush-choose-args/x 2023-01-25T04:51:41.404 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2023-01-25T04:51:42.293 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2023-01-25T04:51:42.293 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:51:42.293 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:51:42.294 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:51:42.294 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:42.294 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:42.294 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:51:42.295 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:51:42.295 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/crush-choose-args/x '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:51:42.327 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:111: TEST_no_update_weight_set: run_osd td/crush-choose-args 0 2023-01-25T04:51:42.328 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:51:42.328 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:51:42.329 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2023-01-25T04:51:42.329 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:51:42.329 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/0 2023-01-25T04:51:42.329 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false ' 2023-01-25T04:51:42.330 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:51:42.330 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:51:42.330 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:51:42.330 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/0' 2023-01-25T04:51:42.330 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/0/journal' 2023-01-25T04:51:42.331 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:51:42.331 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:51:42.331 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:51:42.332 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:51:42.332 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:51:42.332 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:51:42.332 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:51:42.333 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:51:42.333 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:51:42.333 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:51:42.333 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:51:42.333 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:51:42.333 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:51:42.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:51:42.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:51:42.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:51:42.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:51:42.334 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:51:42.335 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:51:42.335 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:51:42.335 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:51:42.335 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/0 2023-01-25T04:51:42.335 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:51:42.336 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=e7843bb2-3bf4-4e57-b486-76c2c73a9e95 2023-01-25T04:51:42.336 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd0 e7843bb2-3bf4-4e57-b486-76c2c73a9e95' 2023-01-25T04:51:42.337 INFO:tasks.workunit.client.0.smithi082.stdout:add osd0 e7843bb2-3bf4-4e57-b486-76c2c73a9e95 2023-01-25T04:51:42.337 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:51:42.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQBetdBjDrLEFBAAk2YmgBXwPweVAO915Hc/Bg== 2023-01-25T04:51:42.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQBetdBjDrLEFBAAk2YmgBXwPweVAO915Hc/Bg=="}' 2023-01-25T04:51:42.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new e7843bb2-3bf4-4e57-b486-76c2c73a9e95 -i td/crush-choose-args/0/new.json 2023-01-25T04:51:42.704 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:51:42.718 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/0/new.json 2023-01-25T04:51:42.719 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBetdBjDrLEFBAAk2YmgBXwPweVAO915Hc/Bg== --osd-uuid e7843bb2-3bf4-4e57-b486-76c2c73a9e95 2023-01-25T04:51:42.748 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:42.747+0000 7fc403d625c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:51:42.750 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:42.749+0000 7fc403d625c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:51:42.751 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:42.750+0000 7fc403d625c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:51:42.752 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:42.751+0000 7fc403d625c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:51:42.752 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:42.751+0000 7fc403d625c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:51:42.752 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:42.751+0000 7fc403d625c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:51:42.804 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:42.803+0000 7fc403d625c0 -1 bluestore(td/crush-choose-args/0) _read_fsid unparsable uuid 2023-01-25T04:51:48.106 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/0/keyring 2023-01-25T04:51:48.106 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:51:48.107 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd0 key to auth repository 2023-01-25T04:51:48.107 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd0 key to auth repository 2023-01-25T04:51:48.108 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:51:48.411 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.0 2023-01-25T04:51:48.413 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.0 2023-01-25T04:51:48.413 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:51:48.413 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:51:48.413 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:51:48.414 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:51:48.441 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:48.440+0000 7f8de54b95c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:51:48.451 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:48.449+0000 7f8de54b95c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:51:48.451 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:48.451+0000 7f8de54b95c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:51:48.899 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 0 2023-01-25T04:51:48.900 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:51:48.900 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=0 2023-01-25T04:51:48.900 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:51:48.900 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:51:48.901 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:48.901 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:51:48.902 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:51:48.902 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:48.902 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:48.991 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:48.990+0000 7f8de54b95c0 -1 Falling back to public interface 2023-01-25T04:51:49.384 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:50.385 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:50.385 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:50.386 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:51:50.386 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:51:50.386 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:50.387 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:50.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:51.449 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:51:51.446+0000 7f8de54b95c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:51:51.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:51.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:51.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:51:51.846 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:51:51.846 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:51.848 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:52.293 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:53.294 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:53.294 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:53.295 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:51:53.295 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:51:53.296 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:53.296 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:53.740 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:54.741 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:54.742 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:54.742 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:51:54.742 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:51:54.743 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:54.743 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:55.277 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:56.279 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:56.279 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:56.279 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:51:56.280 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:51:56.280 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:56.280 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:56.726 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:57.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:57.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:57.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:51:57.729 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:51:57.729 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:57.730 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:58.273 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:51:59.274 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:51:59.274 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:51:59.274 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:51:59.275 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:51:59.275 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:51:59.275 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:51:59.722 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:00.724 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:00.724 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:00.724 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:52:00.725 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:52:00.725 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:00.725 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:01.252 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:02.253 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:02.253 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:02.254 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:52:02.254 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:52:02.254 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:02.255 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:02.947 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:03.948 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:03.948 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:03.948 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:52:03.949 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:52:03.949 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:03.949 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:04.908 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:05.908 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:05.909 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:05.910 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:52:05.910 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:52:05.911 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:05.912 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:06.851 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:07.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:07.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:07.853 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:52:07.853 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:52:07.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:07.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:08.336 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:09.338 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:09.338 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:09.338 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:52:09.339 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:52:09.339 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:09.339 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:10.315 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:11.316 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:11.316 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:11.317 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:52:11.317 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:52:11.318 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:11.318 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:11.920 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:12.920 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:12.920 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:52:12.921 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:52:12.921 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:12.922 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:52:13.500 INFO:tasks.workunit.client.0.smithi082.stdout:osd.0 up in weight 1 up_from 4 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/109193,v1:127.0.0.1:6803/109193] [v2:127.0.0.1:6804/109193,v1:127.0.0.1:6805/109193] exists,up e7843bb2-3bf4-4e57-b486-76c2c73a9e95 2023-01-25T04:52:13.501 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:52:13.501 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:52:13.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:52:13.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:113: TEST_no_update_weight_set: ceph osd set-require-min-compat-client luminous 2023-01-25T04:52:14.361 INFO:tasks.workunit.client.0.smithi082.stderr:set require_min_compat_client to luminous 2023-01-25T04:52:14.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:114: TEST_no_update_weight_set: ceph osd crush tree 2023-01-25T04:52:14.826 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT TYPE NAME 2023-01-25T04:52:14.827 INFO:tasks.workunit.client.0.smithi082.stdout:-1 3.00000 root default 2023-01-25T04:52:14.827 INFO:tasks.workunit.client.0.smithi082.stdout:-2 3.00000 host HOST 2023-01-25T04:52:14.827 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 osd.0 2023-01-25T04:52:14.839 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:115: TEST_no_update_weight_set: ceph osd getcrushmap 2023-01-25T04:52:15.267 INFO:tasks.workunit.client.0.smithi082.stderr:2 2023-01-25T04:52:15.278 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:116: TEST_no_update_weight_set: crushtool -d td/crush-choose-args/map -o td/crush-choose-args/map.txt 2023-01-25T04:52:15.297 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:117: TEST_no_update_weight_set: sed -i -e '/end crush map/d' td/crush-choose-args/map.txt 2023-01-25T04:52:15.298 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:118: TEST_no_update_weight_set: cat 2023-01-25T04:52:15.299 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:141: TEST_no_update_weight_set: crushtool -c td/crush-choose-args/map.txt -o td/crush-choose-args/map-new 2023-01-25T04:52:15.319 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:142: TEST_no_update_weight_set: ceph osd setcrushmap -i td/crush-choose-args/map-new 2023-01-25T04:52:16.200 INFO:tasks.workunit.client.0.smithi082.stderr:4 2023-01-25T04:52:16.210 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:143: TEST_no_update_weight_set: ceph osd crush tree 2023-01-25T04:52:16.649 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT 0 TYPE NAME 2023-01-25T04:52:16.649 INFO:tasks.workunit.client.0.smithi082.stdout:-1 3.00000 root default 2023-01-25T04:52:16.650 INFO:tasks.workunit.client.0.smithi082.stdout:-2 3.00000 2.00000 host HOST 2023-01-25T04:52:16.650 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:52:16.663 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:146: TEST_no_update_weight_set: run_osd td/crush-choose-args 1 2023-01-25T04:52:16.664 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:52:16.664 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:52:16.664 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2023-01-25T04:52:16.664 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:52:16.665 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/1 2023-01-25T04:52:16.665 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false ' 2023-01-25T04:52:16.665 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:52:16.665 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:52:16.665 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:52:16.666 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/1' 2023-01-25T04:52:16.666 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/1/journal' 2023-01-25T04:52:16.666 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:52:16.666 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:52:16.666 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:52:16.667 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:52:16.667 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:52:16.667 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:52:16.667 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:52:16.667 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:16.668 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:16.668 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:52:16.668 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:52:16.668 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:52:16.668 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:52:16.669 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:52:16.669 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:52:16.669 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:52:16.669 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:52:16.669 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:52:16.669 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:52:16.670 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:52:16.670 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:52:16.670 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/1 2023-01-25T04:52:16.670 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:52:16.671 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=be654a68-6f51-4d0c-aaf0-67c9ec2019fc 2023-01-25T04:52:16.671 INFO:tasks.workunit.client.0.smithi082.stdout:add osd1 be654a68-6f51-4d0c-aaf0-67c9ec2019fc 2023-01-25T04:52:16.672 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd1 be654a68-6f51-4d0c-aaf0-67c9ec2019fc' 2023-01-25T04:52:16.672 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:52:16.685 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQCAtdBj5zTFKBAAYNEsPHY4YEUw0xWQtMOODw== 2023-01-25T04:52:16.685 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQCAtdBj5zTFKBAAYNEsPHY4YEUw0xWQtMOODw=="}' 2023-01-25T04:52:16.686 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new be654a68-6f51-4d0c-aaf0-67c9ec2019fc -i td/crush-choose-args/1/new.json 2023-01-25T04:52:17.227 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:52:17.239 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/1/new.json 2023-01-25T04:52:17.240 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCAtdBj5zTFKBAAYNEsPHY4YEUw0xWQtMOODw== --osd-uuid be654a68-6f51-4d0c-aaf0-67c9ec2019fc 2023-01-25T04:52:17.271 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:17.270+0000 7fc7782b45c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:17.284 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:17.284+0000 7fc7782b45c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:17.286 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:17.285+0000 7fc7782b45c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:17.286 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:17.285+0000 7fc7782b45c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:52:17.286 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:17.285+0000 7fc7782b45c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:52:17.287 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:17.285+0000 7fc7782b45c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:52:17.376 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:17.375+0000 7fc7782b45c0 -1 bluestore(td/crush-choose-args/1) _read_fsid unparsable uuid 2023-01-25T04:52:22.908 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/1/keyring 2023-01-25T04:52:22.908 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:52:22.909 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd1 key to auth repository 2023-01-25T04:52:22.910 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd1 key to auth repository 2023-01-25T04:52:22.911 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:52:23.509 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.1 2023-01-25T04:52:23.510 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.1 2023-01-25T04:52:23.510 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:52:23.511 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:52:23.511 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:52:23.511 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:52:23.540 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:23.538+0000 7f78826c65c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:23.541 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:23.540+0000 7f78826c65c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:23.542 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:23.541+0000 7f78826c65c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:23.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 1 2023-01-25T04:52:23.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:52:23.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=1 2023-01-25T04:52:23.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:52:23.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:52:23.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:23.986 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:52:23.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:52:23.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:23.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:24.077 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:24.077+0000 7f78826c65c0 -1 Falling back to public interface 2023-01-25T04:52:24.433 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:25.435 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:25.435 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:25.435 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:52:25.436 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:52:25.436 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:25.436 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:25.924 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:26.553 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:26.552+0000 7f78826c65c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:52:26.925 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:26.926 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:26.926 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:52:26.926 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:52:26.927 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:26.927 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:27.369 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:28.370 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:28.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:28.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:52:28.371 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:52:28.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:28.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:28.922 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:29.923 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:29.923 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:29.923 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:52:29.924 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:52:29.924 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:29.925 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:30.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:31.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:31.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:31.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:52:31.373 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:52:31.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:31.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:31.848 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:32.850 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:32.850 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:32.850 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:52:32.851 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:52:32.851 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:32.851 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:33.409 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:34.411 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:34.411 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:34.412 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:52:34.412 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:52:34.413 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:34.413 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:34.884 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:35.885 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:35.886 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:35.886 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:52:35.886 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:52:35.887 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:35.887 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:36.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:37.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:37.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:37.354 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:52:37.354 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:52:37.354 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:37.355 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:37.957 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:38.958 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:38.958 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:38.959 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:52:38.959 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:52:38.959 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:38.960 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:39.560 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:40.561 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:40.562 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:40.562 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:52:40.563 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:52:40.563 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:40.563 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:41.108 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:42.110 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:42.110 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:42.110 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:52:42.111 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:52:42.111 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:42.111 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:43.042 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:44.043 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:44.044 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:44.044 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:52:44.044 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:52:44.045 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:44.045 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:44.961 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:45.963 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:45.963 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:45.964 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:52:45.964 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:52:45.964 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:45.965 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:46.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:47.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:47.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:47.656 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:52:47.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:52:47.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:47.657 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:48.319 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:52:49.320 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:52:49.321 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:52:49.321 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:52:49.322 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:52:49.322 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:52:49.322 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:52:49.777 INFO:tasks.workunit.client.0.smithi082.stdout:osd.1 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/111032,v1:127.0.0.1:6811/111032] [v2:127.0.0.1:6812/111032,v1:127.0.0.1:6813/111032] exists,up be654a68-6f51-4d0c-aaf0-67c9ec2019fc 2023-01-25T04:52:49.777 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:52:49.778 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:52:49.778 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:52:49.778 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:147: TEST_no_update_weight_set: ceph osd crush tree 2023-01-25T04:52:50.225 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT 0 TYPE NAME 2023-01-25T04:52:50.225 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:52:50.226 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 2.00000 host HOST 2023-01-25T04:52:50.226 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:52:50.226 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 0 osd.1 2023-01-25T04:52:50.237 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:148: TEST_no_update_weight_set: ceph osd getcrushmap 2023-01-25T04:52:50.689 INFO:tasks.workunit.client.0.smithi082.stderr:5 2023-01-25T04:52:50.699 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:149: TEST_no_update_weight_set: crushtool -d td/crush-choose-args/map-one-more -o td/crush-choose-args/map-one-more.txt 2023-01-25T04:52:50.718 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:150: TEST_no_update_weight_set: cat td/crush-choose-args/map-one-more.txt 2023-01-25T04:52:50.719 INFO:tasks.workunit.client.0.smithi082.stdout:# begin crush map 2023-01-25T04:52:50.719 INFO:tasks.workunit.client.0.smithi082.stdout:tunable choose_local_tries 0 2023-01-25T04:52:50.720 INFO:tasks.workunit.client.0.smithi082.stdout:tunable choose_local_fallback_tries 0 2023-01-25T04:52:50.720 INFO:tasks.workunit.client.0.smithi082.stdout:tunable choose_total_tries 50 2023-01-25T04:52:50.720 INFO:tasks.workunit.client.0.smithi082.stdout:tunable chooseleaf_descend_once 1 2023-01-25T04:52:50.720 INFO:tasks.workunit.client.0.smithi082.stdout:tunable chooseleaf_vary_r 1 2023-01-25T04:52:50.720 INFO:tasks.workunit.client.0.smithi082.stdout:tunable chooseleaf_stable 1 2023-01-25T04:52:50.721 INFO:tasks.workunit.client.0.smithi082.stdout:tunable straw_calc_version 1 2023-01-25T04:52:50.721 INFO:tasks.workunit.client.0.smithi082.stdout:tunable allowed_bucket_algs 54 2023-01-25T04:52:50.721 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:52:50.721 INFO:tasks.workunit.client.0.smithi082.stdout:# devices 2023-01-25T04:52:50.721 INFO:tasks.workunit.client.0.smithi082.stdout:device 0 osd.0 2023-01-25T04:52:50.722 INFO:tasks.workunit.client.0.smithi082.stdout:device 1 osd.1 2023-01-25T04:52:50.722 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:52:50.722 INFO:tasks.workunit.client.0.smithi082.stdout:# types 2023-01-25T04:52:50.722 INFO:tasks.workunit.client.0.smithi082.stdout:type 0 osd 2023-01-25T04:52:50.722 INFO:tasks.workunit.client.0.smithi082.stdout:type 1 host 2023-01-25T04:52:50.723 INFO:tasks.workunit.client.0.smithi082.stdout:type 2 chassis 2023-01-25T04:52:50.723 INFO:tasks.workunit.client.0.smithi082.stdout:type 3 rack 2023-01-25T04:52:50.723 INFO:tasks.workunit.client.0.smithi082.stdout:type 4 row 2023-01-25T04:52:50.723 INFO:tasks.workunit.client.0.smithi082.stdout:type 5 pdu 2023-01-25T04:52:50.723 INFO:tasks.workunit.client.0.smithi082.stdout:type 6 pod 2023-01-25T04:52:50.723 INFO:tasks.workunit.client.0.smithi082.stdout:type 7 room 2023-01-25T04:52:50.724 INFO:tasks.workunit.client.0.smithi082.stdout:type 8 datacenter 2023-01-25T04:52:50.724 INFO:tasks.workunit.client.0.smithi082.stdout:type 9 zone 2023-01-25T04:52:50.724 INFO:tasks.workunit.client.0.smithi082.stdout:type 10 region 2023-01-25T04:52:50.724 INFO:tasks.workunit.client.0.smithi082.stdout:type 11 root 2023-01-25T04:52:50.724 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:52:50.725 INFO:tasks.workunit.client.0.smithi082.stdout:# buckets 2023-01-25T04:52:50.725 INFO:tasks.workunit.client.0.smithi082.stdout:host HOST { 2023-01-25T04:52:50.725 INFO:tasks.workunit.client.0.smithi082.stdout: id -2 # do not change unnecessarily 2023-01-25T04:52:50.726 INFO:tasks.workunit.client.0.smithi082.stdout: # weight 6.00000 2023-01-25T04:52:50.726 INFO:tasks.workunit.client.0.smithi082.stdout: alg straw2 2023-01-25T04:52:50.726 INFO:tasks.workunit.client.0.smithi082.stdout: hash 0 # rjenkins1 2023-01-25T04:52:50.726 INFO:tasks.workunit.client.0.smithi082.stdout: item osd.0 weight 3.00000 2023-01-25T04:52:50.726 INFO:tasks.workunit.client.0.smithi082.stdout: item osd.1 weight 3.00000 2023-01-25T04:52:50.727 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:52:50.727 INFO:tasks.workunit.client.0.smithi082.stdout:root default { 2023-01-25T04:52:50.727 INFO:tasks.workunit.client.0.smithi082.stdout: id -1 # do not change unnecessarily 2023-01-25T04:52:50.727 INFO:tasks.workunit.client.0.smithi082.stdout: # weight 6.00000 2023-01-25T04:52:50.727 INFO:tasks.workunit.client.0.smithi082.stdout: alg straw2 2023-01-25T04:52:50.728 INFO:tasks.workunit.client.0.smithi082.stdout: hash 0 # rjenkins1 2023-01-25T04:52:50.728 INFO:tasks.workunit.client.0.smithi082.stdout: item HOST weight 6.00000 2023-01-25T04:52:50.728 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:52:50.728 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:52:50.728 INFO:tasks.workunit.client.0.smithi082.stdout:# rules 2023-01-25T04:52:50.728 INFO:tasks.workunit.client.0.smithi082.stdout:rule replicated_rule { 2023-01-25T04:52:50.729 INFO:tasks.workunit.client.0.smithi082.stdout: id 0 2023-01-25T04:52:50.729 INFO:tasks.workunit.client.0.smithi082.stdout: type replicated 2023-01-25T04:52:50.729 INFO:tasks.workunit.client.0.smithi082.stdout: step take default 2023-01-25T04:52:50.729 INFO:tasks.workunit.client.0.smithi082.stdout: step choose firstn 0 type osd 2023-01-25T04:52:50.729 INFO:tasks.workunit.client.0.smithi082.stdout: step emit 2023-01-25T04:52:50.730 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:52:50.730 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:52:50.730 INFO:tasks.workunit.client.0.smithi082.stdout:# choose_args 2023-01-25T04:52:50.730 INFO:tasks.workunit.client.0.smithi082.stdout:choose_args 0 { 2023-01-25T04:52:50.730 INFO:tasks.workunit.client.0.smithi082.stdout: { 2023-01-25T04:52:50.731 INFO:tasks.workunit.client.0.smithi082.stdout: bucket_id -1 2023-01-25T04:52:50.731 INFO:tasks.workunit.client.0.smithi082.stdout: weight_set [ 2023-01-25T04:52:50.731 INFO:tasks.workunit.client.0.smithi082.stdout: [ 2.00000 ] 2023-01-25T04:52:50.731 INFO:tasks.workunit.client.0.smithi082.stdout: [ 1.00000 ] 2023-01-25T04:52:50.731 INFO:tasks.workunit.client.0.smithi082.stdout: ] 2023-01-25T04:52:50.731 INFO:tasks.workunit.client.0.smithi082.stdout: ids [ -10 ] 2023-01-25T04:52:50.732 INFO:tasks.workunit.client.0.smithi082.stdout: } 2023-01-25T04:52:50.732 INFO:tasks.workunit.client.0.smithi082.stdout: { 2023-01-25T04:52:50.732 INFO:tasks.workunit.client.0.smithi082.stdout: bucket_id -2 2023-01-25T04:52:50.732 INFO:tasks.workunit.client.0.smithi082.stdout: weight_set [ 2023-01-25T04:52:50.733 INFO:tasks.workunit.client.0.smithi082.stdout: [ 2.00000 0.00000 ] 2023-01-25T04:52:50.733 INFO:tasks.workunit.client.0.smithi082.stdout: [ 1.00000 0.00000 ] 2023-01-25T04:52:50.733 INFO:tasks.workunit.client.0.smithi082.stdout: ] 2023-01-25T04:52:50.733 INFO:tasks.workunit.client.0.smithi082.stdout: ids [ -20 1 ] 2023-01-25T04:52:50.733 INFO:tasks.workunit.client.0.smithi082.stdout: } 2023-01-25T04:52:50.734 INFO:tasks.workunit.client.0.smithi082.stdout:} 2023-01-25T04:52:50.734 INFO:tasks.workunit.client.0.smithi082.stdout: 2023-01-25T04:52:50.734 INFO:tasks.workunit.client.0.smithi082.stdout:# end crush map 2023-01-25T04:52:50.735 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:151: TEST_no_update_weight_set: diff -u td/crush-choose-args/map-one-more.txt /home/ubuntu/cephtest/clone.client.0/src/test/crush/crush-choose-args-expected-one-more-0.txt 2023-01-25T04:52:50.735 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:153: TEST_no_update_weight_set: destroy_osd td/crush-choose-args 1 2023-01-25T04:52:50.736 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:783: destroy_osd: local dir=td/crush-choose-args 2023-01-25T04:52:50.736 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:784: destroy_osd: local id=1 2023-01-25T04:52:50.736 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:786: destroy_osd: ceph osd out osd.1 2023-01-25T04:52:51.316 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 is already out. 2023-01-25T04:52:51.326 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:787: destroy_osd: kill_daemons td/crush-choose-args TERM osd.1 2023-01-25T04:52:51.327 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:52:51.327 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:52:51.327 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:52:51.327 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:52:51.328 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:52:51.632 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:52:51.633 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:788: destroy_osd: ceph osd down osd.1 2023-01-25T04:52:52.097 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 is already down. 2023-01-25T04:52:52.103 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:789: destroy_osd: ceph osd purge osd.1 --yes-i-really-mean-it 2023-01-25T04:52:52.629 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 does not exist 2023-01-25T04:52:52.640 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:790: destroy_osd: teardown td/crush-choose-args/1 2023-01-25T04:52:52.640 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args/1 2023-01-25T04:52:52.640 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:52:52.641 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args/1 KILL 2023-01-25T04:52:52.641 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:52:52.641 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:52:52.642 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:52:52.642 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:52:52.642 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:52:52.644 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:52:52.644 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:52:52.644 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:52:52.644 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:52:52.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:52:52.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:52:52.645 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:52:52.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:52:52.648 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:52:52.648 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:52:52.649 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:52:52.649 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:52:52.649 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:52:52.650 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args/1 2023-01-25T04:52:52.651 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:52:52.652 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:52.652 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:52.652 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:52:52.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:52:52.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:52:52.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:791: destroy_osd: rm -fr td/crush-choose-args/1 2023-01-25T04:52:52.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:154: TEST_no_update_weight_set: ceph osd crush tree 2023-01-25T04:52:53.128 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT 0 TYPE NAME 2023-01-25T04:52:53.128 INFO:tasks.workunit.client.0.smithi082.stdout:-1 3.00000 root default 2023-01-25T04:52:53.129 INFO:tasks.workunit.client.0.smithi082.stdout:-2 3.00000 2.00000 host HOST 2023-01-25T04:52:53.129 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:52:53.141 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:155: TEST_no_update_weight_set: ceph osd getcrushmap 2023-01-25T04:52:53.608 INFO:tasks.workunit.client.0.smithi082.stderr:6 2023-01-25T04:52:53.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:156: TEST_no_update_weight_set: crushtool -d td/crush-choose-args/map-one-less -o td/crush-choose-args/map-one-less.txt 2023-01-25T04:52:53.637 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:157: TEST_no_update_weight_set: diff -u td/crush-choose-args/map-one-less.txt td/crush-choose-args/map.txt 2023-01-25T04:52:53.639 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:159: TEST_no_update_weight_set: CEPH_ARGS='--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false ' 2023-01-25T04:52:53.640 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:41: run: teardown td/crush-choose-args 2023-01-25T04:52:53.640 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:52:53.640 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:52:53.640 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:52:53.641 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:52:53.641 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:52:53.642 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:52:53.643 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:52:53.643 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:52:53.745 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:52:53.746 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:52:53.746 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:52:53.746 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:52:53.747 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:52:53.747 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:52:53.748 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:52:53.749 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:52:53.749 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:52:53.750 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:52:53.750 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:52:53.750 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:52:53.751 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:52:53.751 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:52:53.758 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:52:53.758 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:53.758 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:53.758 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:52:53.760 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:52:53.760 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:52:53.760 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:38: run: for func in $funcs 2023-01-25T04:52:53.761 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:39: run: setup td/crush-choose-args 2023-01-25T04:52:53.761 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/crush-choose-args 2023-01-25T04:52:53.761 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/crush-choose-args 2023-01-25T04:52:53.761 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:52:53.761 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:52:53.762 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:52:53.762 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:52:53.762 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:52:53.762 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:52:53.762 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:52:53.763 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:52:53.764 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:52:53.764 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:52:53.764 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:52:53.764 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:52:53.765 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:52:53.765 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:52:53.765 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:52:53.767 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:52:53.767 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:52:53.767 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:52:53.768 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:52:53.768 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:52:53.770 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:52:53.770 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:52:53.770 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:52:53.770 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:53.771 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:53.771 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:52:53.771 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:52:53.771 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:52:53.771 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/crush-choose-args 2023-01-25T04:52:53.772 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2023-01-25T04:52:53.772 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:53.772 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:53.772 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.99479 2023-01-25T04:52:53.774 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2023-01-25T04:52:53.774 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2023-01-25T04:52:53.774 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2023-01-25T04:52:53.774 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/crush-choose-args 1' TERM HUP INT 2023-01-25T04:52:53.775 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:40: run: TEST_reweight td/crush-choose-args 2023-01-25T04:52:53.775 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:164: TEST_reweight: local dir=td/crush-choose-args 2023-01-25T04:52:53.775 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:166: TEST_reweight: ORIG_CEPH_ARGS='--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false ' 2023-01-25T04:52:53.775 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:167: TEST_reweight: CEPH_ARGS+='--osd-crush-update-weight-set=false ' 2023-01-25T04:52:53.775 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:169: TEST_reweight: run_mon td/crush-choose-args a 2023-01-25T04:52:53.776 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/crush-choose-args 2023-01-25T04:52:53.776 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2023-01-25T04:52:53.776 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2023-01-25T04:52:53.776 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2023-01-25T04:52:53.777 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/crush-choose-args/a 2023-01-25T04:52:53.777 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/crush-choose-args/a --run-dir=td/crush-choose-args 2023-01-25T04:52:54.136 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2023-01-25T04:52:54.137 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:52:54.137 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:52:54.137 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:52:54.137 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:54.138 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:54.138 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:52:54.138 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/crush-choose-args/a '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --mon-cluster-log-file=td/crush-choose-args/log --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2023-01-25T04:52:54.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2023-01-25T04:52:54.373 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2023-01-25T04:52:54.373 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:52:54.374 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:52:54.374 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=fsid 2023-01-25T04:52:54.374 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .fsid 2023-01-25T04:52:54.374 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:52:54.374 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:52:54.375 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:52:54.375 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:52:54.375 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:54.375 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:54.375 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:52:54.376 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:52:54.376 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get fsid 2023-01-25T04:52:54.475 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2023-01-25T04:52:54.475 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:52:54.475 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:52:54.476 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=mon_host 2023-01-25T04:52:54.476 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .mon_host 2023-01-25T04:52:54.476 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:52:54.476 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:52:54.476 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:52:54.477 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:52:54.477 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:54.477 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:54.477 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.99479/ceph-mon.a.asok 2023-01-25T04:52:54.477 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:52:54.478 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.99479/ceph-mon.a.asok config get mon_host 2023-01-25T04:52:54.575 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:170: TEST_reweight: run_mgr td/crush-choose-args x 2023-01-25T04:52:54.575 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/crush-choose-args 2023-01-25T04:52:54.575 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2023-01-25T04:52:54.576 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2023-01-25T04:52:54.576 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2023-01-25T04:52:54.576 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/crush-choose-args/x 2023-01-25T04:52:54.576 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2023-01-25T04:52:55.463 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2023-01-25T04:52:55.463 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:52:55.464 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:52:55.464 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:52:55.465 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:55.465 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:55.465 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:52:55.466 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:52:55.466 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/crush-choose-args/x '--log-file=td/crush-choose-args/$name.log' '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --run-dir=td/crush-choose-args '--pid-file=td/crush-choose-args/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2023-01-25T04:52:55.500 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:171: TEST_reweight: run_osd td/crush-choose-args 0 2023-01-25T04:52:55.500 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:52:55.500 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:52:55.501 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2023-01-25T04:52:55.501 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:52:55.501 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/0 2023-01-25T04:52:55.501 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false ' 2023-01-25T04:52:55.501 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:52:55.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:52:55.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:52:55.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/0' 2023-01-25T04:52:55.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/0/journal' 2023-01-25T04:52:55.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:52:55.503 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:52:55.503 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:52:55.503 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:52:55.503 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:52:55.503 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:52:55.504 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:52:55.504 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:52:55.504 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:52:55.504 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:52:55.504 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:52:55.505 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:52:55.505 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:52:55.505 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:52:55.505 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:52:55.505 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:52:55.506 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:52:55.506 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:52:55.506 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:52:55.506 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:52:55.506 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:52:55.507 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/0 2023-01-25T04:52:55.507 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:52:55.507 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=f2c9d5a4-a5e8-4cc8-a3a1-2351681fb046 2023-01-25T04:52:55.507 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd0 f2c9d5a4-a5e8-4cc8-a3a1-2351681fb046' 2023-01-25T04:52:55.508 INFO:tasks.workunit.client.0.smithi082.stdout:add osd0 f2c9d5a4-a5e8-4cc8-a3a1-2351681fb046 2023-01-25T04:52:55.508 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:52:55.518 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQCntdBjRqXKHhAAOchLgww53pqypjyTnkcpXA== 2023-01-25T04:52:55.519 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQCntdBjRqXKHhAAOchLgww53pqypjyTnkcpXA=="}' 2023-01-25T04:52:55.519 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new f2c9d5a4-a5e8-4cc8-a3a1-2351681fb046 -i td/crush-choose-args/0/new.json 2023-01-25T04:52:55.884 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:52:55.895 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/0/new.json 2023-01-25T04:52:55.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCntdBjRqXKHhAAOchLgww53pqypjyTnkcpXA== --osd-uuid f2c9d5a4-a5e8-4cc8-a3a1-2351681fb046 2023-01-25T04:52:55.927 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:55.925+0000 7f50522095c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:55.929 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:55.927+0000 7f50522095c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:55.930 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:55.928+0000 7f50522095c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:52:55.931 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:55.929+0000 7f50522095c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:52:55.931 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:55.929+0000 7f50522095c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:52:55.931 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:55.929+0000 7f50522095c0 -1 bluestore(td/crush-choose-args/0/block) _read_bdev_label failed to open td/crush-choose-args/0/block: (2) No such file or directory 2023-01-25T04:52:56.006 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:52:56.004+0000 7f50522095c0 -1 bluestore(td/crush-choose-args/0) _read_fsid unparsable uuid 2023-01-25T04:53:01.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/0/keyring 2023-01-25T04:53:01.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:53:01.372 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd0 key to auth repository 2023-01-25T04:53:01.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd0 key to auth repository 2023-01-25T04:53:01.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:53:01.654 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.0 2023-01-25T04:53:01.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.0 2023-01-25T04:53:01.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 0 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/0 --osd-journal=td/crush-choose-args/0/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:53:01.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:53:01.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:53:01.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:53:01.684 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:01.682+0000 7f0a13c345c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:01.686 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:01.685+0000 7f0a13c345c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:01.687 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:01.686+0000 7f0a13c345c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:02.151 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 0 2023-01-25T04:53:02.152 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:53:02.152 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=0 2023-01-25T04:53:02.152 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:53:02.152 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:53:02.153 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:02.153 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:53:02.154 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:53:02.154 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:02.154 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:02.213 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:02.211+0000 7f0a13c345c0 -1 Falling back to public interface 2023-01-25T04:53:02.644 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:03.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:03.645 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:03.646 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:53:03.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:53:03.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:03.647 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:04.106 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:04.682 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:04.681+0000 7f0a13c345c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:53:05.108 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:05.108 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:05.108 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:53:05.109 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:53:05.109 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:05.109 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:05.615 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:06.616 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:06.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:06.617 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:53:06.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:53:06.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:06.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:07.227 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:08.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:08.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:08.229 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:53:08.229 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:53:08.230 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:08.230 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:08.677 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:09.679 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:09.679 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:09.679 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:53:09.680 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:53:09.680 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:09.681 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:10.215 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:11.216 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:11.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:11.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:53:11.217 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:53:11.218 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:11.218 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:11.665 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:12.667 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:12.667 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:12.667 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:53:12.668 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:53:12.668 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:12.669 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:13.232 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:14.233 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:14.233 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:14.233 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:53:14.234 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:53:14.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:14.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:14.684 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:15.686 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:15.686 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:15.687 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:53:15.688 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:53:15.688 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:15.688 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:16.531 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:17.533 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:17.533 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:17.534 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:53:17.535 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:53:17.535 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:17.536 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:18.348 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:19.350 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:19.350 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:19.350 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:53:19.351 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:53:19.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:19.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:20.370 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:21.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:21.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:21.372 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:53:21.372 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:53:21.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:21.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:22.315 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:23.316 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:23.316 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:23.317 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:53:23.317 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:53:23.318 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:23.318 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:24.182 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:25.183 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:25.184 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:25.184 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:53:25.184 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:53:25.185 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:25.185 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:25.781 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:26.782 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:26.782 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:26.783 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:53:26.783 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:53:26.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:26.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:53:27.223 INFO:tasks.workunit.client.0.smithi082.stdout:osd.0 up in weight 1 up_from 4 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/113290,v1:127.0.0.1:6803/113290] [v2:127.0.0.1:6804/113290,v1:127.0.0.1:6805/113290] exists,up f2c9d5a4-a5e8-4cc8-a3a1-2351681fb046 2023-01-25T04:53:27.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:53:27.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:53:27.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:53:27.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:172: TEST_reweight: run_osd td/crush-choose-args 1 2023-01-25T04:53:27.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:53:27.229 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:53:27.229 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2023-01-25T04:53:27.229 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:53:27.229 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/1 2023-01-25T04:53:27.230 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false ' 2023-01-25T04:53:27.230 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:53:27.230 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:53:27.230 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:53:27.230 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/1' 2023-01-25T04:53:27.231 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/1/journal' 2023-01-25T04:53:27.231 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:53:27.231 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:53:27.231 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:53:27.231 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:53:27.232 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:53:27.232 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:53:27.232 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:53:27.232 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:53:27.232 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:53:27.233 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:53:27.233 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:53:27.233 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:53:27.233 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:53:27.233 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:53:27.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:53:27.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:53:27.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:53:27.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:53:27.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:53:27.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:53:27.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:53:27.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/1 2023-01-25T04:53:27.235 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:53:27.236 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=a77f1294-d5d4-46cc-875f-383b8a8be7fa 2023-01-25T04:53:27.236 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd1 a77f1294-d5d4-46cc-875f-383b8a8be7fa' 2023-01-25T04:53:27.236 INFO:tasks.workunit.client.0.smithi082.stdout:add osd1 a77f1294-d5d4-46cc-875f-383b8a8be7fa 2023-01-25T04:53:27.236 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:53:27.248 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQDHtdBjPg+4DhAAxHHg6DFD4VmOlBWsRXvGEg== 2023-01-25T04:53:27.248 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQDHtdBjPg+4DhAAxHHg6DFD4VmOlBWsRXvGEg=="}' 2023-01-25T04:53:27.248 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new a77f1294-d5d4-46cc-875f-383b8a8be7fa -i td/crush-choose-args/1/new.json 2023-01-25T04:53:27.870 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:53:27.882 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/1/new.json 2023-01-25T04:53:27.883 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDHtdBjPg+4DhAAxHHg6DFD4VmOlBWsRXvGEg== --osd-uuid a77f1294-d5d4-46cc-875f-383b8a8be7fa 2023-01-25T04:53:27.914 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:27.913+0000 7fe77924e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:27.916 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:27.915+0000 7fe77924e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:27.917 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:27.916+0000 7fe77924e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:27.917 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:27.916+0000 7fe77924e5c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:53:27.918 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:27.916+0000 7fe77924e5c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:53:27.918 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:27.916+0000 7fe77924e5c0 -1 bluestore(td/crush-choose-args/1/block) _read_bdev_label failed to open td/crush-choose-args/1/block: (2) No such file or directory 2023-01-25T04:53:28.022 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:28.022+0000 7fe77924e5c0 -1 bluestore(td/crush-choose-args/1) _read_fsid unparsable uuid 2023-01-25T04:53:33.482 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/1/keyring 2023-01-25T04:53:33.482 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:53:33.483 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd1 key to auth repository 2023-01-25T04:53:33.483 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd1 key to auth repository 2023-01-25T04:53:33.484 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:53:34.083 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.1 2023-01-25T04:53:34.083 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.1 2023-01-25T04:53:34.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 1 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/1 --osd-journal=td/crush-choose-args/1/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:53:34.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:53:34.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:53:34.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:53:34.112 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:34.111+0000 7f702e5015c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:34.115 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:34.113+0000 7f702e5015c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:34.116 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:34.114+0000 7f702e5015c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:53:34.553 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 1 2023-01-25T04:53:34.554 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:53:34.554 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=1 2023-01-25T04:53:34.554 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:53:34.554 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:53:34.554 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:34.555 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:53:34.555 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:53:34.555 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:34.556 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:34.641 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:34.639+0000 7f702e5015c0 -1 Falling back to public interface 2023-01-25T04:53:35.028 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:36.030 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:36.030 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:36.031 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:53:36.031 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:53:36.032 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:36.032 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:36.489 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:37.002 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:53:37.000+0000 7f702e5015c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:53:37.491 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:37.492 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:37.492 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:53:37.492 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:53:37.493 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:37.493 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:37.932 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:38.933 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:38.934 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:38.934 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:53:38.934 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:53:38.935 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:38.935 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:39.468 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:40.469 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:40.469 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:40.470 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:53:40.470 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:53:40.470 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:40.471 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:40.914 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:41.916 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:41.917 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:41.917 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:53:41.917 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:53:41.918 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:41.918 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:42.364 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:43.365 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:43.366 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:43.366 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:53:43.366 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:53:43.367 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:43.367 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:43.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:44.994 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:44.994 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:44.994 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:53:44.995 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:53:44.995 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:44.995 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:45.582 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:46.583 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:46.584 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:46.584 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:53:46.585 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:53:46.586 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:46.586 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:47.029 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:48.031 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:48.032 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:48.032 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:53:48.033 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:53:48.034 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:48.034 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:48.959 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:49.960 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:49.960 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:49.960 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:53:49.961 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:53:49.961 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:49.962 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:50.466 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:51.468 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:51.468 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:51.469 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:53:51.469 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:53:51.469 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:51.470 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:52.323 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:53.324 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:53.324 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:53.324 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:53:53.325 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:53:53.325 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:53.325 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:54.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:55.055 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:55.055 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:55.055 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:53:55.056 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:53:55.056 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:55.056 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:56.163 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:57.164 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:57.164 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:57.165 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:53:57.165 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:53:57.166 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:57.166 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:57.862 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:53:58.863 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:53:58.864 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:53:58.864 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:53:58.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:53:58.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:53:58.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:53:59.308 INFO:tasks.workunit.client.0.smithi082.stdout:osd.1 up in weight 1 up_from 8 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/115005,v1:127.0.0.1:6811/115005] [v2:127.0.0.1:6812/115005,v1:127.0.0.1:6813/115005] exists,up a77f1294-d5d4-46cc-875f-383b8a8be7fa 2023-01-25T04:53:59.309 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:53:59.310 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:53:59.310 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:53:59.310 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:174: TEST_reweight: ceph osd crush weight-set create-compat 2023-01-25T04:53:59.904 INFO:tasks.workunit.client.0.smithi082.stderr:compat weight-set already created 2023-01-25T04:53:59.914 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:175: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:00.403 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:54:00.403 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:54:00.403 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 6.00000 host HOST 2023-01-25T04:54:00.404 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 3.00000 osd.0 2023-01-25T04:54:00.404 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 3.00000 osd.1 2023-01-25T04:54:00.415 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:177: TEST_reweight: ceph osd crush weight-set reweight-compat osd.0 2 2023-01-25T04:54:01.418 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:178: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:01.900 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:54:01.900 INFO:tasks.workunit.client.0.smithi082.stdout:-1 6.00000 root default 2023-01-25T04:54:01.900 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 5.00000 host HOST 2023-01-25T04:54:01.900 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:54:01.901 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 3.00000 osd.1 2023-01-25T04:54:01.912 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:179: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:01.912 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:179: TEST_reweight: grep host 2023-01-25T04:54:01.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:179: TEST_reweight: grep '6.00000 5.00000' 2023-01-25T04:54:02.368 INFO:tasks.workunit.client.0.smithi082.stdout:-2 6.00000 5.00000 host HOST 2023-01-25T04:54:02.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:181: TEST_reweight: run_osd td/crush-choose-args 2 2023-01-25T04:54:02.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-choose-args 2023-01-25T04:54:02.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:54:02.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2023-01-25T04:54:02.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:54:02.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-choose-args/2 2023-01-25T04:54:02.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false ' 2023-01-25T04:54:02.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:54:02.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:54:02.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:54:02.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-choose-args/2' 2023-01-25T04:54:02.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-choose-args/2/journal' 2023-01-25T04:54:02.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:54:02.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:54:02.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-choose-args' 2023-01-25T04:54:02.377 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:54:02.377 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:54:02.377 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:54:02.377 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:54:02.377 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:02.378 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:54:02.378 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:54:02.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' 2023-01-25T04:54:02.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:54:02.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:54:02.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:54:02.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-choose-args/$name.log' 2023-01-25T04:54:02.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-choose-args/$name.pid' 2023-01-25T04:54:02.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:54:02.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:54:02.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:54:02.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:54:02.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:54:02.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-choose-args/2 2023-01-25T04:54:02.380 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:54:02.381 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=113218aa-6354-453e-a293-f8a4cf5439b0 2023-01-25T04:54:02.381 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd2 113218aa-6354-453e-a293-f8a4cf5439b0' 2023-01-25T04:54:02.381 INFO:tasks.workunit.client.0.smithi082.stdout:add osd2 113218aa-6354-453e-a293-f8a4cf5439b0 2023-01-25T04:54:02.382 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:54:02.392 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQDqtdBjcG5RFxAAQA8xJlxNQC+azkVvKAGZOw== 2023-01-25T04:54:02.393 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQDqtdBjcG5RFxAAQA8xJlxNQC+azkVvKAGZOw=="}' 2023-01-25T04:54:02.393 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 113218aa-6354-453e-a293-f8a4cf5439b0 -i td/crush-choose-args/2/new.json 2023-01-25T04:54:02.936 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:54:02.949 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-choose-args/2/new.json 2023-01-25T04:54:02.949 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 2 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/2 --osd-journal=td/crush-choose-args/2/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDqtdBjcG5RFxAAQA8xJlxNQC+azkVvKAGZOw== --osd-uuid 113218aa-6354-453e-a293-f8a4cf5439b0 2023-01-25T04:54:02.981 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:02.980+0000 7fdd794955c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:02.982 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:02.982+0000 7fdd794955c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:02.984 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:02.983+0000 7fdd794955c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:02.984 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:02.983+0000 7fdd794955c0 -1 bluestore(td/crush-choose-args/2/block) _read_bdev_label failed to open td/crush-choose-args/2/block: (2) No such file or directory 2023-01-25T04:54:02.984 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:02.983+0000 7fdd794955c0 -1 bluestore(td/crush-choose-args/2/block) _read_bdev_label failed to open td/crush-choose-args/2/block: (2) No such file or directory 2023-01-25T04:54:02.985 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:02.983+0000 7fdd794955c0 -1 bluestore(td/crush-choose-args/2/block) _read_bdev_label failed to open td/crush-choose-args/2/block: (2) No such file or directory 2023-01-25T04:54:03.060 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:03.059+0000 7fdd794955c0 -1 bluestore(td/crush-choose-args/2) _read_fsid unparsable uuid 2023-01-25T04:54:08.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-choose-args/2/keyring 2023-01-25T04:54:08.976 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:54:08.976 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd2 key to auth repository 2023-01-25T04:54:08.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd2 key to auth repository 2023-01-25T04:54:08.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-choose-args/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:54:09.586 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.2 2023-01-25T04:54:09.587 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.2 2023-01-25T04:54:09.587 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:54:09.587 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 2 --fsid=4fc10a0c-c318-4c7c-84d9-0ae368325a1a --auth-supported=none --mon-host=127.0.0.1:7131 --crush-location=root=default,host=HOST --osd-crush-initial-weight=3 --osd-class-update-on-start=false --osd-crush-update-weight-set=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-choose-args/2 --osd-journal=td/crush-choose-args/2/journal --chdir= --run-dir=td/crush-choose-args '--admin-socket=/tmp/ceph-asok.99479/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-choose-args/$name.log' '--pid-file=td/crush-choose-args/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:54:09.588 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:54:09.588 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:54:09.615 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:09.615+0000 7f47128965c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:09.617 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:09.617+0000 7f47128965c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:09.618 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:09.618+0000 7f47128965c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:10.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 2 2023-01-25T04:54:10.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:54:10.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=2 2023-01-25T04:54:10.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:54:10.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:54:10.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:10.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:54:10.086 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:54:10.087 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:10.087 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:10.152 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:10.151+0000 7f47128965c0 -1 Falling back to public interface 2023-01-25T04:54:10.584 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:11.585 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:11.586 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:11.586 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:54:11.587 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:54:11.587 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:11.587 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:12.045 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:12.524 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:12.522+0000 7f47128965c0 -1 osd.2 0 log_to_monitors true 2023-01-25T04:54:13.046 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:13.046 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:13.046 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:54:13.047 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:54:13.047 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:13.048 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:13.599 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:14.600 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:14.600 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:54:14.601 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:54:14.601 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:14.602 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:15.073 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:16.075 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:16.075 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:16.075 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:54:16.076 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:54:16.076 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:16.077 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:16.532 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:17.533 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:17.534 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:17.534 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:54:17.535 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:54:17.535 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:17.535 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:17.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:18.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:18.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:18.986 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:54:18.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:54:18.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:18.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:19.448 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:20.449 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:20.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:20.450 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:54:20.451 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:54:20.451 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:20.451 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:20.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:21.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:21.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:21.893 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:54:21.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:54:21.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:21.894 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:22.455 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:23.456 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:23.457 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:23.457 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:54:23.458 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:54:23.458 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:23.458 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:24.059 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:25.060 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:25.060 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:25.061 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:54:25.061 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:54:25.061 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:25.062 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:25.851 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:26.853 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:26.853 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:26.853 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:54:26.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:54:26.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:26.855 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:27.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:28.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:28.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:28.892 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:54:28.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:54:28.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:28.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:29.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:30.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:30.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:30.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:54:30.988 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:54:30.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:30.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:31.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:32.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:32.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:32.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:54:32.822 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:54:32.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:32.823 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:33.795 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:34.797 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:34.797 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:34.797 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:54:34.798 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:54:34.798 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:34.799 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:54:35.254 INFO:tasks.workunit.client.0.smithi082.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/116834,v1:127.0.0.1:6819/116834] [v2:127.0.0.1:6820/116834,v1:127.0.0.1:6821/116834] exists,up 113218aa-6354-453e-a293-f8a4cf5439b0 2023-01-25T04:54:35.255 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:54:35.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:54:35.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:54:35.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:182: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:35.773 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:54:35.774 INFO:tasks.workunit.client.0.smithi082.stdout:-1 9.00000 root default 2023-01-25T04:54:35.774 INFO:tasks.workunit.client.0.smithi082.stdout:-2 9.00000 5.00000 host HOST 2023-01-25T04:54:35.774 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:54:35.774 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 3.00000 osd.1 2023-01-25T04:54:35.774 INFO:tasks.workunit.client.0.smithi082.stdout: 2 3.00000 0 osd.2 2023-01-25T04:54:35.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:183: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:35.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:183: TEST_reweight: grep host 2023-01-25T04:54:35.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:183: TEST_reweight: grep '9.00000 5.00000' 2023-01-25T04:54:36.247 INFO:tasks.workunit.client.0.smithi082.stdout:-2 9.00000 5.00000 host HOST 2023-01-25T04:54:36.248 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:185: TEST_reweight: ceph osd crush reweight osd.2 4 2023-01-25T04:54:36.948 INFO:tasks.workunit.client.0.smithi082.stderr:reweighted item id 2 name 'osd.2' to 4 in crush map 2023-01-25T04:54:36.957 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:186: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:37.438 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:54:37.438 INFO:tasks.workunit.client.0.smithi082.stdout:-1 10.00000 root default 2023-01-25T04:54:37.438 INFO:tasks.workunit.client.0.smithi082.stdout:-2 10.00000 5.00000 host HOST 2023-01-25T04:54:37.438 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:54:37.439 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 3.00000 osd.1 2023-01-25T04:54:37.439 INFO:tasks.workunit.client.0.smithi082.stdout: 2 4.00000 0 osd.2 2023-01-25T04:54:37.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:187: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:37.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:187: TEST_reweight: grep host 2023-01-25T04:54:37.451 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:187: TEST_reweight: grep '10.00000 5.00000' 2023-01-25T04:54:37.978 INFO:tasks.workunit.client.0.smithi082.stdout:-2 10.00000 5.00000 host HOST 2023-01-25T04:54:37.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:189: TEST_reweight: ceph osd crush weight-set reweight-compat osd.2 4 2023-01-25T04:54:38.747 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:190: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:39.201 INFO:tasks.workunit.client.0.smithi082.stdout:ID CLASS WEIGHT (compat) TYPE NAME 2023-01-25T04:54:39.201 INFO:tasks.workunit.client.0.smithi082.stdout:-1 10.00000 root default 2023-01-25T04:54:39.202 INFO:tasks.workunit.client.0.smithi082.stdout:-2 10.00000 9.00000 host HOST 2023-01-25T04:54:39.202 INFO:tasks.workunit.client.0.smithi082.stdout: 0 3.00000 2.00000 osd.0 2023-01-25T04:54:39.202 INFO:tasks.workunit.client.0.smithi082.stdout: 1 3.00000 3.00000 osd.1 2023-01-25T04:54:39.202 INFO:tasks.workunit.client.0.smithi082.stdout: 2 4.00000 4.00000 osd.2 2023-01-25T04:54:39.214 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:191: TEST_reweight: ceph osd crush tree 2023-01-25T04:54:39.214 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:191: TEST_reweight: grep host 2023-01-25T04:54:39.215 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:191: TEST_reweight: grep '10.00000 9.00000' 2023-01-25T04:54:39.687 INFO:tasks.workunit.client.0.smithi082.stdout:-2 10.00000 9.00000 host HOST 2023-01-25T04:54:39.688 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh:41: run: teardown td/crush-choose-args 2023-01-25T04:54:39.689 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:54:39.689 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:54:39.689 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:54:39.689 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:54:39.689 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:54:39.690 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:54:39.690 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:54:39.690 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:54:39.795 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:54:39.796 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:54:39.797 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:54:39.797 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:54:39.798 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:54:39.798 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:54:39.798 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:54:39.799 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:54:39.800 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:54:39.800 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:54:39.801 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:54:39.801 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:54:39.802 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:54:39.802 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:54:39.813 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:54:39.813 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:39.813 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:54:39.813 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:54:39.815 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:54:39.815 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:54:39.815 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2244: main: code=0 2023-01-25T04:54:39.815 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2248: main: teardown td/crush-choose-args 0 2023-01-25T04:54:39.816 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-choose-args 2023-01-25T04:54:39.816 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2023-01-25T04:54:39.816 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-choose-args KILL 2023-01-25T04:54:39.816 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:54:39.816 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:54:39.817 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:54:39.817 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:54:39.817 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:54:39.818 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:54:39.818 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:54:39.819 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:54:39.819 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:54:39.819 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:54:39.819 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:54:39.819 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:54:39.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:54:39.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:54:39.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:54:39.821 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:54:39.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:54:39.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2023-01-25T04:54:39.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-choose-args 2023-01-25T04:54:39.823 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:54:39.823 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:39.823 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.99479 2023-01-25T04:54:39.824 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.99479 2023-01-25T04:54:39.825 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:54:39.825 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:54:39.825 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2249: main: return 0 2023-01-25T04:54:39.826 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-01-25T04:54:39.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-01-25T04:54:39.894 INFO:tasks.workunit:Running workunit crush/crush-classes.sh... 2023-01-25T04:54:39.895 DEBUG:teuthology.orchestra.run.smithi082:workunit test crush/crush-classes.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=61996d73ab738798e4ee0055c86457f5c459da4a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh 2023-01-25T04:54:39.959 INFO:tasks.workunit.client.0.smithi082.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-01-25T04:54:39.970 INFO:tasks.workunit.client.0.smithi082.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2023-01-25T04:54:39.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-01-25T04:54:39.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2237: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-01-25T04:54:39.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2238: main: export PYTHONWARNINGS=ignore 2023-01-25T04:54:39.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2238: main: PYTHONWARNINGS=ignore 2023-01-25T04:54:39.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: main: export CEPH_CONF=/dev/null 2023-01-25T04:54:39.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2239: main: CEPH_CONF=/dev/null 2023-01-25T04:54:39.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2240: main: unset CEPH_ARGS 2023-01-25T04:54:39.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2242: main: local code 2023-01-25T04:54:39.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2243: main: run td/crush-classes 2023-01-25T04:54:39.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:21: run: local dir=td/crush-classes 2023-01-25T04:54:39.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:22: run: shift 2023-01-25T04:54:39.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:24: run: export CEPH_MON=127.0.0.1:7130 2023-01-25T04:54:39.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:24: run: CEPH_MON=127.0.0.1:7130 2023-01-25T04:54:39.974 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:25: run: export CEPH_ARGS 2023-01-25T04:54:39.974 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:26: run: uuidgen 2023-01-25T04:54:39.974 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:26: run: CEPH_ARGS+='--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none ' 2023-01-25T04:54:39.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7130 ' 2023-01-25T04:54:39.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:31: run: CEPH_ARGS+='--osd-class-update-on-start=false ' 2023-01-25T04:54:39.975 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:33: run: set 2023-01-25T04:54:39.975 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:33: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2023-01-25T04:54:39.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:33: run: local 'funcs=TEST_classes 2023-01-25T04:54:39.976 INFO:tasks.workunit.client.0.smithi082.stderr:TEST_mon_classes 2023-01-25T04:54:39.976 INFO:tasks.workunit.client.0.smithi082.stderr:TEST_reweight_vs_classes 2023-01-25T04:54:39.976 INFO:tasks.workunit.client.0.smithi082.stderr:TEST_set_device_class' 2023-01-25T04:54:39.976 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:34: run: for func in $funcs 2023-01-25T04:54:39.976 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:35: run: setup td/crush-classes 2023-01-25T04:54:39.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/crush-classes 2023-01-25T04:54:39.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/crush-classes 2023-01-25T04:54:39.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-classes 2023-01-25T04:54:39.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:54:39.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-classes KILL 2023-01-25T04:54:39.978 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:54:39.978 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:54:39.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:54:39.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:54:39.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:54:39.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:54:39.981 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:54:39.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:54:39.981 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:54:39.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:54:39.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:54:39.982 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:54:39.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:54:39.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:54:39.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:54:39.983 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:54:39.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:54:39.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:54:39.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-classes 2023-01-25T04:54:39.983 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:54:39.984 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:39.984 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:54:39.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.118012 2023-01-25T04:54:39.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:54:39.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:54:39.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/crush-classes 2023-01-25T04:54:39.985 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2023-01-25T04:54:39.985 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:39.985 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:54:39.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.118012 2023-01-25T04:54:39.987 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2023-01-25T04:54:39.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2023-01-25T04:54:39.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2023-01-25T04:54:39.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2023-01-25T04:54:39.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/crush-classes 1' TERM HUP INT 2023-01-25T04:54:39.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:36: run: TEST_classes td/crush-classes 2023-01-25T04:54:39.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:89: TEST_classes: local dir=td/crush-classes 2023-01-25T04:54:39.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:91: TEST_classes: run_mon td/crush-classes a 2023-01-25T04:54:39.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/crush-classes 2023-01-25T04:54:39.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2023-01-25T04:54:39.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2023-01-25T04:54:39.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2023-01-25T04:54:39.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/crush-classes/a 2023-01-25T04:54:39.990 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/crush-classes/a --run-dir=td/crush-classes 2023-01-25T04:54:40.379 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2023-01-25T04:54:40.379 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:54:40.379 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:54:40.379 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:54:40.380 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:40.380 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:54:40.381 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:54:40.381 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/crush-classes/a '--log-file=td/crush-classes/$name.log' '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --mon-cluster-log-file=td/crush-classes/log --run-dir=td/crush-classes '--pid-file=td/crush-classes/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2023-01-25T04:54:40.630 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2023-01-25T04:54:40.632 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2023-01-25T04:54:40.632 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:54:40.633 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:54:40.633 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=fsid 2023-01-25T04:54:40.633 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .fsid 2023-01-25T04:54:40.633 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:54:40.633 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:54:40.634 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:54:40.634 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:54:40.634 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:40.634 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:54:40.634 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.118012/ceph-mon.a.asok 2023-01-25T04:54:40.635 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:54:40.635 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.118012/ceph-mon.a.asok config get fsid 2023-01-25T04:54:40.734 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2023-01-25T04:54:40.734 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:54:40.735 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:54:40.735 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=mon_host 2023-01-25T04:54:40.735 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .mon_host 2023-01-25T04:54:40.735 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:54:40.735 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:54:40.736 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:54:40.736 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:54:40.736 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:40.736 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:54:40.736 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.118012/ceph-mon.a.asok 2023-01-25T04:54:40.737 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:54:40.737 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.118012/ceph-mon.a.asok config get mon_host 2023-01-25T04:54:40.838 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:92: TEST_classes: run_osd td/crush-classes 0 2023-01-25T04:54:40.839 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:54:40.839 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:54:40.839 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2023-01-25T04:54:40.839 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:54:40.840 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/0 2023-01-25T04:54:40.840 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:54:40.840 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:54:40.840 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:54:40.840 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:54:40.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/0' 2023-01-25T04:54:40.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/0/journal' 2023-01-25T04:54:40.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:54:40.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:54:40.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:54:40.842 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:54:40.842 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:54:40.842 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:54:40.842 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:54:40.842 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:54:40.843 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:54:40.843 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:54:40.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:54:40.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:54:40.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:54:40.844 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:54:40.844 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:54:40.844 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:54:40.844 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:54:40.844 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:54:40.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:54:40.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:54:40.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:54:40.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/0 2023-01-25T04:54:40.845 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:54:40.846 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=691e0d45-4627-409f-b13b-b459e2bc4e18 2023-01-25T04:54:40.846 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd0 691e0d45-4627-409f-b13b-b459e2bc4e18' 2023-01-25T04:54:40.846 INFO:tasks.workunit.client.0.smithi082.stdout:add osd0 691e0d45-4627-409f-b13b-b459e2bc4e18 2023-01-25T04:54:40.847 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:54:40.856 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQAQttBjbTr+MhAA3kWxKENPiEnRbRHdT3DnHQ== 2023-01-25T04:54:40.857 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQAQttBjbTr+MhAA3kWxKENPiEnRbRHdT3DnHQ=="}' 2023-01-25T04:54:40.857 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 691e0d45-4627-409f-b13b-b459e2bc4e18 -i td/crush-classes/0/new.json 2023-01-25T04:54:41.821 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:54:41.832 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/0/new.json 2023-01-25T04:54:41.833 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 0 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/0 --osd-journal=td/crush-classes/0/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAQttBjbTr+MhAA3kWxKENPiEnRbRHdT3DnHQ== --osd-uuid 691e0d45-4627-409f-b13b-b459e2bc4e18 2023-01-25T04:54:41.860 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:41.858+0000 7f7a651745c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:41.862 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:41.861+0000 7f7a651745c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:41.863 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:41.862+0000 7f7a651745c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:41.864 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:41.862+0000 7f7a651745c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:54:41.864 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:41.862+0000 7f7a651745c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:54:41.864 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:41.862+0000 7f7a651745c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:54:41.946 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:41.945+0000 7f7a651745c0 -1 bluestore(td/crush-classes/0) _read_fsid unparsable uuid 2023-01-25T04:54:47.247 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/0/keyring 2023-01-25T04:54:47.247 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:54:47.248 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd0 key to auth repository 2023-01-25T04:54:47.249 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd0 key to auth repository 2023-01-25T04:54:47.249 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:54:47.493 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.0 2023-01-25T04:54:47.493 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.0 2023-01-25T04:54:47.494 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 0 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/0 --osd-journal=td/crush-classes/0/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:54:47.494 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:54:47.494 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:54:47.495 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:54:47.518 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:47.516+0000 7efc4f1f55c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:47.520 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:47.519+0000 7efc4f1f55c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:47.522 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:47.520+0000 7efc4f1f55c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:54:47.721 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 0 2023-01-25T04:54:47.721 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:54:47.721 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=0 2023-01-25T04:54:47.721 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:54:47.722 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:54:47.722 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:47.722 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:54:47.722 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:54:47.723 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:47.723 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:47.969 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:48.036 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:48.034+0000 7efc4f1f55c0 -1 Falling back to public interface 2023-01-25T04:54:48.970 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:48.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:48.971 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:54:48.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:54:48.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:48.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:49.196 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:50.197 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:50.197 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:50.198 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:54:50.198 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:54:50.199 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:50.199 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:50.324 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:54:50.322+0000 7efc4f1f55c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:54:50.425 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:51.426 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:51.427 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:51.427 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:54:51.427 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:54:51.428 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:51.428 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:51.652 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:52.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:52.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:52.654 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:54:52.654 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:54:52.654 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:52.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:52.883 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:53.885 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:53.885 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:53.885 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:54:53.886 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:54:53.886 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:53.886 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:54.117 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:55.118 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:55.119 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:55.119 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:54:55.119 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:54:55.120 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:55.120 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:55.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:56.355 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:56.355 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:56.355 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:54:56.356 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:54:56.356 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:56.356 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:56.589 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:57.590 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:57.590 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:57.590 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:54:57.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:54:57.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:57.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:57.825 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:54:58.827 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:54:58.827 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:54:58.827 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:54:58.828 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:54:58.828 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:54:58.828 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:54:59.056 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:00.057 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:00.057 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:00.057 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:55:00.058 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:55:00.058 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:00.058 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:00.282 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:01.283 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:01.284 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:01.284 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:55:01.284 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:55:01.285 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:01.285 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:01.509 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:02.510 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:02.511 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:02.511 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:55:02.512 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:55:02.512 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:02.512 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:02.739 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:03.741 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:03.741 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:03.741 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:55:03.742 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:55:03.742 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:03.742 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:03.968 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:04.970 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:04.970 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:04.970 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:55:04.971 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:55:04.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:04.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:05.196 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:06.199 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:06.199 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:06.199 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:55:06.200 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:55:06.200 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:06.201 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:06.424 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:07.425 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:07.425 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:07.426 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:55:07.426 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:55:07.427 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:07.427 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:07.651 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:08.652 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:08.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:08.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:55:08.653 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:55:08.654 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:08.654 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:08.877 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:09.879 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:09.879 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:09.879 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 18 2023-01-25T04:55:09.880 INFO:tasks.workunit.client.0.smithi082.stdout:18 2023-01-25T04:55:09.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:09.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:10.123 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:11.123 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:11.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:11.124 INFO:tasks.workunit.client.0.smithi082.stdout:19 2023-01-25T04:55:11.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 19 2023-01-25T04:55:11.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:11.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:55:11.346 INFO:tasks.workunit.client.0.smithi082.stdout:osd.0 up in weight 1 up_from 4 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/118955,v1:127.0.0.1:6801/118955] [v2:127.0.0.1:6802/118955,v1:127.0.0.1:6803/118955] exists,up 691e0d45-4627-409f-b13b-b459e2bc4e18 2023-01-25T04:55:11.349 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:55:11.350 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:55:11.350 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:55:11.350 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:93: TEST_classes: run_osd td/crush-classes 1 2023-01-25T04:55:11.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:55:11.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:55:11.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2023-01-25T04:55:11.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:55:11.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/1 2023-01-25T04:55:11.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:55:11.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:55:11.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:55:11.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:55:11.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/1' 2023-01-25T04:55:11.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/1/journal' 2023-01-25T04:55:11.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:55:11.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:55:11.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:55:11.353 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:55:11.354 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:55:11.354 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:55:11.354 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:55:11.354 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:55:11.355 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:55:11.355 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:55:11.355 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:55:11.356 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:55:11.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:55:11.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:55:11.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:55:11.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:55:11.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:55:11.358 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:55:11.358 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:55:11.358 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:55:11.358 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:55:11.358 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/1 2023-01-25T04:55:11.358 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:55:11.359 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=e21a9e16-841e-4106-bfe9-8d1853c7d4d5 2023-01-25T04:55:11.359 INFO:tasks.workunit.client.0.smithi082.stdout:add osd1 e21a9e16-841e-4106-bfe9-8d1853c7d4d5 2023-01-25T04:55:11.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd1 e21a9e16-841e-4106-bfe9-8d1853c7d4d5' 2023-01-25T04:55:11.360 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:55:11.367 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQAvttBjXmvXFRAARK2ndHGlYrtQC8/E9gfAbw== 2023-01-25T04:55:11.368 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQAvttBjXmvXFRAARK2ndHGlYrtQC8/E9gfAbw=="}' 2023-01-25T04:55:11.368 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new e21a9e16-841e-4106-bfe9-8d1853c7d4d5 -i td/crush-classes/1/new.json 2023-01-25T04:55:11.684 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:55:11.694 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/1/new.json 2023-01-25T04:55:11.695 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 1 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/1 --osd-journal=td/crush-classes/1/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQAvttBjXmvXFRAARK2ndHGlYrtQC8/E9gfAbw== --osd-uuid e21a9e16-841e-4106-bfe9-8d1853c7d4d5 2023-01-25T04:55:11.722 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:11.721+0000 7f6f7f65d5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:11.724 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:11.723+0000 7f6f7f65d5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:11.725 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:11.724+0000 7f6f7f65d5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:11.729 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:11.725+0000 7f6f7f65d5c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:55:11.729 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:11.725+0000 7f6f7f65d5c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:55:11.729 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:11.725+0000 7f6f7f65d5c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:55:11.825 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:11.825+0000 7f6f7f65d5c0 -1 bluestore(td/crush-classes/1) _read_fsid unparsable uuid 2023-01-25T04:55:17.444 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/1/keyring 2023-01-25T04:55:17.444 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:55:17.445 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd1 key to auth repository 2023-01-25T04:55:17.445 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd1 key to auth repository 2023-01-25T04:55:17.445 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:55:17.688 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.1 2023-01-25T04:55:17.689 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.1 2023-01-25T04:55:17.690 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 1 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/1 --osd-journal=td/crush-classes/1/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:55:17.690 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:55:17.690 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:55:17.690 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:55:17.714 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:17.712+0000 7fb64c9435c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:17.716 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:17.714+0000 7fb64c9435c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:17.717 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:17.715+0000 7fb64c9435c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:17.912 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 1 2023-01-25T04:55:17.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:55:17.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=1 2023-01-25T04:55:17.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:55:17.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:55:17.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:17.914 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:55:17.914 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:55:17.915 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:17.915 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:18.134 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:18.243 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:18.242+0000 7fb64c9435c0 -1 Falling back to public interface 2023-01-25T04:55:19.136 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:19.136 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:19.136 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:55:19.137 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:55:19.137 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:19.137 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:19.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:20.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:20.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:20.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:55:20.363 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:55:20.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:20.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:20.580 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:20.579+0000 7fb64c9435c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:55:20.590 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:21.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:21.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:21.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:55:21.592 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:55:21.593 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:21.593 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:21.827 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:22.829 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:22.829 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:22.829 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:55:22.829 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:55:22.830 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:22.830 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:23.064 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:24.065 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:24.065 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:24.066 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:55:24.066 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:55:24.067 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:24.067 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:24.300 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:25.303 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:25.303 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:25.303 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:55:25.304 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:55:25.304 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:25.305 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:25.536 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:26.538 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:26.538 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:26.538 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:55:26.539 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:55:26.540 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:26.540 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:26.772 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:27.774 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:27.774 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:27.774 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:55:27.775 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:55:27.775 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:27.776 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:28.007 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:29.008 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:29.009 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:29.009 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:55:29.009 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:55:29.010 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:29.010 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:29.243 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:30.245 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:30.245 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:30.245 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:55:30.246 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:55:30.246 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:30.246 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:30.473 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:31.474 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:31.474 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:31.474 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:55:31.475 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:55:31.475 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:31.475 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:31.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:32.844 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:32.845 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:32.845 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:55:32.846 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:55:32.846 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:32.846 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:33.074 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:34.076 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:34.076 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:34.076 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:55:34.077 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:55:34.077 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:34.077 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:34.299 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:35.301 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:35.301 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:35.301 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:55:35.302 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:55:35.302 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:35.303 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:35.529 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:36.530 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:36.531 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:36.531 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:55:36.531 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:55:36.532 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:36.532 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:36.783 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:37.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:37.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:37.784 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:55:37.786 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:55:37.786 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:37.787 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:38.008 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:39.010 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:39.010 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:39.010 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:55:39.011 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:55:39.011 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:39.011 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:39.238 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:40.239 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:40.239 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:40.240 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 18 2023-01-25T04:55:40.240 INFO:tasks.workunit.client.0.smithi082.stdout:18 2023-01-25T04:55:40.241 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:40.241 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:55:40.471 INFO:tasks.workunit.client.0.smithi082.stdout:osd.1 up in weight 1 up_from 8 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/120766,v1:127.0.0.1:6809/120766] [v2:127.0.0.1:6810/120766,v1:127.0.0.1:6811/120766] exists,up e21a9e16-841e-4106-bfe9-8d1853c7d4d5 2023-01-25T04:55:40.478 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:55:40.478 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:55:40.478 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:55:40.479 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:94: TEST_classes: run_osd td/crush-classes 2 2023-01-25T04:55:40.479 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:55:40.479 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:55:40.480 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2023-01-25T04:55:40.480 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:55:40.480 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/2 2023-01-25T04:55:40.481 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:55:40.481 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:55:40.481 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:55:40.481 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:55:40.481 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/2' 2023-01-25T04:55:40.482 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/2/journal' 2023-01-25T04:55:40.482 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:55:40.482 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:55:40.482 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:55:40.482 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:55:40.483 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:55:40.483 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:55:40.483 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:55:40.484 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:55:40.484 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:55:40.485 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:55:40.485 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:55:40.485 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:55:40.486 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:55:40.486 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:55:40.486 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:55:40.486 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:55:40.487 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:55:40.487 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:55:40.487 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:55:40.487 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:55:40.488 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:55:40.488 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/2 2023-01-25T04:55:40.488 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:55:40.488 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=6d0db267-ae99-4dda-b4e8-122eebf32d65 2023-01-25T04:55:40.489 INFO:tasks.workunit.client.0.smithi082.stdout:add osd2 6d0db267-ae99-4dda-b4e8-122eebf32d65 2023-01-25T04:55:40.490 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd2 6d0db267-ae99-4dda-b4e8-122eebf32d65' 2023-01-25T04:55:40.490 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:55:40.493 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQBMttBjCNBVHRAAhIJjKCt+QMPNw4frHgyMJQ== 2023-01-25T04:55:40.493 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQBMttBjCNBVHRAAhIJjKCt+QMPNw4frHgyMJQ=="}' 2023-01-25T04:55:40.493 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 6d0db267-ae99-4dda-b4e8-122eebf32d65 -i td/crush-classes/2/new.json 2023-01-25T04:55:40.864 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:55:40.875 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/2/new.json 2023-01-25T04:55:40.876 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 2 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/2 --osd-journal=td/crush-classes/2/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBMttBjCNBVHRAAhIJjKCt+QMPNw4frHgyMJQ== --osd-uuid 6d0db267-ae99-4dda-b4e8-122eebf32d65 2023-01-25T04:55:40.904 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:40.902+0000 7f3593a565c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:40.906 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:40.904+0000 7f3593a565c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:40.906 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:40.905+0000 7f3593a565c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:40.907 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:40.905+0000 7f3593a565c0 -1 bluestore(td/crush-classes/2/block) _read_bdev_label failed to open td/crush-classes/2/block: (2) No such file or directory 2023-01-25T04:55:40.907 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:40.905+0000 7f3593a565c0 -1 bluestore(td/crush-classes/2/block) _read_bdev_label failed to open td/crush-classes/2/block: (2) No such file or directory 2023-01-25T04:55:40.908 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:40.905+0000 7f3593a565c0 -1 bluestore(td/crush-classes/2/block) _read_bdev_label failed to open td/crush-classes/2/block: (2) No such file or directory 2023-01-25T04:55:40.981 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:40.979+0000 7f3593a565c0 -1 bluestore(td/crush-classes/2) _read_fsid unparsable uuid 2023-01-25T04:55:46.571 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/2/keyring 2023-01-25T04:55:46.571 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:55:46.572 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd2 key to auth repository 2023-01-25T04:55:46.572 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd2 key to auth repository 2023-01-25T04:55:46.573 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:55:46.813 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.2 2023-01-25T04:55:46.814 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.2 2023-01-25T04:55:46.814 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 2 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/2 --osd-journal=td/crush-classes/2/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:55:46.814 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:55:46.815 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:55:46.815 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:55:46.838 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:46.838+0000 7f6dde0175c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:46.840 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:46.840+0000 7f6dde0175c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:46.841 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:46.841+0000 7f6dde0175c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:55:47.039 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 2 2023-01-25T04:55:47.040 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:55:47.040 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=2 2023-01-25T04:55:47.040 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:55:47.040 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:55:47.040 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:47.041 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:55:47.041 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:55:47.042 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:47.042 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:47.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:47.360 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:47.360+0000 7f6dde0175c0 -1 Falling back to public interface 2023-01-25T04:55:48.264 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:48.264 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:48.264 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:55:48.265 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:55:48.265 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:48.265 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:48.488 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:49.489 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:49.489 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:49.489 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:55:49.490 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:55:49.490 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:49.490 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:49.711 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:49.744 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:55:49.744+0000 7f6dde0175c0 -1 osd.2 0 log_to_monitors true 2023-01-25T04:55:50.712 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:50.713 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:50.713 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:55:50.713 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:55:50.714 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:50.714 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:50.948 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:51.950 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:51.950 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:51.950 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:55:51.951 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:55:51.951 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:51.951 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:52.184 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:53.185 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:53.185 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:53.185 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:55:53.186 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:55:53.186 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:53.186 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:53.419 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:54.420 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:54.421 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:54.421 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:55:54.421 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:55:54.422 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:54.422 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:54.654 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:55.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:55.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:55.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:55:55.656 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:55:55.657 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:55.657 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:55.886 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:56.887 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:56.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:56.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:55:56.888 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:55:56.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:56.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:57.122 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:58.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:58.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:58.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:55:58.125 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:55:58.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:58.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:58.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:55:59.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:55:59.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:55:59.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:55:59.363 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:55:59.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:55:59.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:55:59.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:00.594 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:00.594 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:00.594 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:56:00.595 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:56:00.595 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:00.595 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:00.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:01.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:01.823 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:01.823 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:56:01.824 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:56:01.824 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:01.824 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:02.050 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:03.051 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:03.051 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:03.052 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:56:03.052 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:56:03.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:03.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:03.278 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:04.279 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:04.280 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:04.280 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:56:04.281 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:56:04.281 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:04.281 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:04.507 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:05.509 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:05.509 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:05.509 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:56:05.510 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:56:05.510 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:05.510 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:05.736 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:06.738 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:06.738 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:06.738 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:56:06.739 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:56:06.739 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:06.739 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:07.153 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:08.155 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:08.155 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:08.156 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:56:08.156 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:56:08.157 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:08.157 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:08.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:09.381 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:09.381 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:09.381 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 18 2023-01-25T04:56:09.382 INFO:tasks.workunit.client.0.smithi082.stdout:18 2023-01-25T04:56:09.383 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:09.383 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:56:09.604 INFO:tasks.workunit.client.0.smithi082.stdout:osd.2 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/122560,v1:127.0.0.1:6817/122560] [v2:127.0.0.1:6818/122560,v1:127.0.0.1:6819/122560] exists,up 6d0db267-ae99-4dda-b4e8-122eebf32d65 2023-01-25T04:56:09.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:56:09.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:56:09.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:56:09.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:95: TEST_classes: create_rbd_pool 2023-01-25T04:56:09.605 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2023-01-25T04:56:09.830 INFO:tasks.workunit.client.0.smithi082.stderr:pool 'rbd' does not exist 2023-01-25T04:56:09.838 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2023-01-25T04:56:09.839 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2023-01-25T04:56:10.193 INFO:tasks.workunit.client.0.smithi082.stderr:pool 'rbd' already exists 2023-01-25T04:56:10.202 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2023-01-25T04:56:11.204 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2023-01-25T04:56:12.945 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:97: TEST_classes: get_osds_up rbd SOMETHING 2023-01-25T04:56:12.945 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:51: get_osds_up: local poolname=rbd 2023-01-25T04:56:12.945 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:52: get_osds_up: local objectname=SOMETHING 2023-01-25T04:56:12.946 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: ceph --format xml osd map rbd SOMETHING 2023-01-25T04:56:12.946 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: xmlstarlet sel -t -m //up/osd -v . -o ' ' 2023-01-25T04:56:13.202 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: local 'osds=1 2 0 ' 2023-01-25T04:56:13.202 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:57: get_osds_up: echo 1 2 0 2023-01-25T04:56:13.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:97: TEST_classes: test '1 2 0' == '1 2 0' 2023-01-25T04:56:13.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:98: TEST_classes: add_something td/crush-classes SOMETHING 2023-01-25T04:56:13.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:42: add_something: local dir=td/crush-classes 2023-01-25T04:56:13.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:43: add_something: local obj=SOMETHING 2023-01-25T04:56:13.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:45: add_something: local payload=ABCDEF 2023-01-25T04:56:13.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:46: add_something: echo ABCDEF 2023-01-25T04:56:13.204 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:47: add_something: rados --pool rbd put SOMETHING td/crush-classes/ORIGINAL 2023-01-25T04:56:13.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:104: TEST_classes: ceph osd getcrushmap 2023-01-25T04:56:13.569 INFO:tasks.workunit.client.0.smithi082.stderr:4 2023-01-25T04:56:13.579 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:105: TEST_classes: crushtool -d td/crush-classes/map -o td/crush-classes/map.txt 2023-01-25T04:56:13.595 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:106: TEST_classes: sed -i -e '/device 0 osd.0/s/$/ class ssd/' -e '/step take default/s/$/ class ssd/' td/crush-classes/map.txt 2023-01-25T04:56:13.597 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:110: TEST_classes: crushtool -c td/crush-classes/map.txt -o td/crush-classes/map-new 2023-01-25T04:56:13.614 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:111: TEST_classes: ceph osd setcrushmap -i td/crush-classes/map-new 2023-01-25T04:56:14.361 INFO:tasks.workunit.client.0.smithi082.stderr:6 2023-01-25T04:56:14.370 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:117: TEST_classes: ok=false 2023-01-25T04:56:14.371 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:118: TEST_classes: for delay in 2 4 8 16 32 64 128 256 2023-01-25T04:56:14.371 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:119: TEST_classes: get_osds_up rbd SOMETHING_ELSE 2023-01-25T04:56:14.372 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:51: get_osds_up: local poolname=rbd 2023-01-25T04:56:14.372 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:52: get_osds_up: local objectname=SOMETHING_ELSE 2023-01-25T04:56:14.372 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: ceph --format xml osd map rbd SOMETHING_ELSE 2023-01-25T04:56:14.372 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: xmlstarlet sel -t -m //up/osd -v . -o ' ' 2023-01-25T04:56:14.654 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: local 'osds=0 ' 2023-01-25T04:56:14.654 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:57: get_osds_up: echo 0 2023-01-25T04:56:14.654 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:119: TEST_classes: test 0 == 0 2023-01-25T04:56:14.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:120: TEST_classes: ok=true 2023-01-25T04:56:14.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:121: TEST_classes: break 2023-01-25T04:56:14.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:127: TEST_classes: true 2023-01-25T04:56:14.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:132: TEST_classes: add_something td/crush-classes SOMETHING_ELSE 2023-01-25T04:56:14.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:42: add_something: local dir=td/crush-classes 2023-01-25T04:56:14.655 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:43: add_something: local obj=SOMETHING_ELSE 2023-01-25T04:56:14.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:45: add_something: local payload=ABCDEF 2023-01-25T04:56:14.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:46: add_something: echo ABCDEF 2023-01-25T04:56:14.656 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:47: add_something: rados --pool rbd put SOMETHING_ELSE td/crush-classes/ORIGINAL 2023-01-25T04:56:15.619 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:138: TEST_classes: ceph osd crush dump 2023-01-25T04:56:15.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:138: TEST_classes: grep -q '~ssd' 2023-01-25T04:56:15.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:37: run: teardown td/crush-classes 2023-01-25T04:56:15.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-classes 2023-01-25T04:56:15.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:56:15.852 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-classes KILL 2023-01-25T04:56:15.852 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:56:15.853 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:56:15.853 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:56:15.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:56:15.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:56:15.959 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:56:15.959 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:56:15.960 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:56:15.960 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:56:15.960 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:56:15.961 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:56:15.961 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:56:15.962 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:56:15.963 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:56:15.963 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:56:15.964 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:56:15.964 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:56:15.965 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:56:15.965 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-classes 2023-01-25T04:56:15.975 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:56:15.975 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:15.976 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:15.976 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.118012 2023-01-25T04:56:15.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:56:15.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:56:15.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:34: run: for func in $funcs 2023-01-25T04:56:15.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:35: run: setup td/crush-classes 2023-01-25T04:56:15.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/crush-classes 2023-01-25T04:56:15.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/crush-classes 2023-01-25T04:56:15.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-classes 2023-01-25T04:56:15.980 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:56:15.980 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-classes KILL 2023-01-25T04:56:15.980 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:56:15.980 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:56:15.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:56:15.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:56:15.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:56:15.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:56:15.982 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:56:15.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:56:15.983 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:56:15.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:56:15.983 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:56:15.984 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:56:15.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:56:15.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:56:15.984 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:56:15.985 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:56:15.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:56:15.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:56:15.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-classes 2023-01-25T04:56:15.986 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:56:15.987 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:15.987 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:15.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.118012 2023-01-25T04:56:15.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:56:15.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:56:15.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/crush-classes 2023-01-25T04:56:15.990 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2023-01-25T04:56:15.990 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:15.990 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:15.991 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.118012 2023-01-25T04:56:15.991 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2023-01-25T04:56:15.991 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2023-01-25T04:56:15.991 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2023-01-25T04:56:15.992 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/crush-classes 1' TERM HUP INT 2023-01-25T04:56:15.992 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:36: run: TEST_mon_classes td/crush-classes 2023-01-25T04:56:15.992 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:167: TEST_mon_classes: local dir=td/crush-classes 2023-01-25T04:56:15.992 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:169: TEST_mon_classes: run_mon td/crush-classes a 2023-01-25T04:56:15.992 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/crush-classes 2023-01-25T04:56:15.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2023-01-25T04:56:15.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2023-01-25T04:56:15.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2023-01-25T04:56:15.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/crush-classes/a 2023-01-25T04:56:15.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/crush-classes/a --run-dir=td/crush-classes 2023-01-25T04:56:16.351 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2023-01-25T04:56:16.351 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:56:16.352 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:56:16.352 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:56:16.353 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:16.353 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:16.353 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:56:16.353 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/crush-classes/a '--log-file=td/crush-classes/$name.log' '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --mon-cluster-log-file=td/crush-classes/log --run-dir=td/crush-classes '--pid-file=td/crush-classes/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2023-01-25T04:56:16.627 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2023-01-25T04:56:16.630 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2023-01-25T04:56:16.631 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:56:16.631 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:56:16.631 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=fsid 2023-01-25T04:56:16.632 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .fsid 2023-01-25T04:56:16.632 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:56:16.632 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:56:16.633 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:56:16.633 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:56:16.634 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:16.634 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:16.635 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.118012/ceph-mon.a.asok 2023-01-25T04:56:16.635 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:56:16.635 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.118012/ceph-mon.a.asok config get fsid 2023-01-25T04:56:16.731 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2023-01-25T04:56:16.731 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:56:16.731 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:56:16.732 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=mon_host 2023-01-25T04:56:16.732 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .mon_host 2023-01-25T04:56:16.732 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:56:16.732 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:56:16.733 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:56:16.733 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:56:16.733 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:16.733 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:16.733 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.118012/ceph-mon.a.asok 2023-01-25T04:56:16.734 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:56:16.734 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.118012/ceph-mon.a.asok config get mon_host 2023-01-25T04:56:16.835 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:170: TEST_mon_classes: run_osd td/crush-classes 0 2023-01-25T04:56:16.836 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:56:16.836 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:56:16.836 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2023-01-25T04:56:16.836 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:56:16.836 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/0 2023-01-25T04:56:16.837 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:56:16.837 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:56:16.837 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:56:16.838 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:56:16.838 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/0' 2023-01-25T04:56:16.838 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/0/journal' 2023-01-25T04:56:16.838 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:56:16.838 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:56:16.839 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:56:16.839 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:56:16.839 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:56:16.839 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:56:16.839 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:56:16.840 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:16.840 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:16.840 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:56:16.840 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:56:16.840 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:56:16.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:56:16.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:56:16.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:56:16.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:56:16.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:56:16.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:56:16.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:56:16.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:56:16.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:56:16.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/0 2023-01-25T04:56:16.843 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:56:16.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=7d815480-7a63-4dfb-a13e-d7e8a813a40c 2023-01-25T04:56:16.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd0 7d815480-7a63-4dfb-a13e-d7e8a813a40c' 2023-01-25T04:56:16.844 INFO:tasks.workunit.client.0.smithi082.stdout:add osd0 7d815480-7a63-4dfb-a13e-d7e8a813a40c 2023-01-25T04:56:16.844 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:56:16.853 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQBwttBjVHnLMhAAc4YcfQsgAWIpcWWybII8ng== 2023-01-25T04:56:16.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQBwttBjVHnLMhAAc4YcfQsgAWIpcWWybII8ng=="}' 2023-01-25T04:56:16.854 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 7d815480-7a63-4dfb-a13e-d7e8a813a40c -i td/crush-classes/0/new.json 2023-01-25T04:56:17.820 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:56:17.831 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/0/new.json 2023-01-25T04:56:17.832 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 0 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/0 --osd-journal=td/crush-classes/0/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQBwttBjVHnLMhAAc4YcfQsgAWIpcWWybII8ng== --osd-uuid 7d815480-7a63-4dfb-a13e-d7e8a813a40c 2023-01-25T04:56:17.860 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:17.858+0000 7fb81cda75c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:17.885 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:17.883+0000 7fb81cda75c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:17.886 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:17.884+0000 7fb81cda75c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:17.886 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:17.884+0000 7fb81cda75c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:56:17.886 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:17.884+0000 7fb81cda75c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:56:17.887 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:17.884+0000 7fb81cda75c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:56:17.977 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:17.975+0000 7fb81cda75c0 -1 bluestore(td/crush-classes/0) _read_fsid unparsable uuid 2023-01-25T04:56:22.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/0/keyring 2023-01-25T04:56:22.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:56:22.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd0 key to auth repository 2023-01-25T04:56:22.973 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd0 key to auth repository 2023-01-25T04:56:22.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:56:23.215 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.0 2023-01-25T04:56:23.215 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.0 2023-01-25T04:56:23.216 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 0 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/0 --osd-journal=td/crush-classes/0/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:56:23.216 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:56:23.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:56:23.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:56:23.240 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:23.238+0000 7fb2015dc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:23.242 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:23.241+0000 7fb2015dc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:23.243 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:23.242+0000 7fb2015dc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:23.441 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 0 2023-01-25T04:56:23.441 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:56:23.442 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=0 2023-01-25T04:56:23.442 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:56:23.442 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:56:23.442 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:23.442 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:56:23.443 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:56:23.443 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:23.444 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:23.664 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:23.761 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:23.760+0000 7fb2015dc5c0 -1 Falling back to public interface 2023-01-25T04:56:24.665 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:24.666 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:24.666 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:56:24.667 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:56:24.667 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:24.667 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:24.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:25.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:25.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:25.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:56:25.893 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:56:25.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:25.894 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:26.016 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:26.014+0000 7fb2015dc5c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:56:26.122 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:27.123 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:27.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:27.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:56:27.124 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:56:27.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:27.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:27.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:28.359 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:28.359 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:28.359 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:56:28.360 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:56:28.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:28.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:28.591 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:29.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:29.592 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:29.593 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:56:29.593 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:56:29.593 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:29.594 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:29.818 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:30.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:30.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:30.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:56:30.821 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:56:30.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:30.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:31.050 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:32.051 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:32.051 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:32.051 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:56:32.052 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:56:32.052 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:32.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:32.284 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:33.285 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:33.286 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:33.286 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:56:33.287 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:56:33.287 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:33.287 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:33.520 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:34.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:34.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:34.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:56:34.522 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:56:34.523 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:34.523 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:34.755 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:35.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:35.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:35.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:56:35.758 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:56:35.758 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:35.759 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:35.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:36.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:36.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:36.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:56:36.990 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:56:36.990 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:36.990 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:37.215 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:38.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:38.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:38.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:56:38.218 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:56:38.218 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:38.218 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:38.453 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:39.455 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:39.456 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:39.456 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:56:39.457 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:56:39.457 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:39.458 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:39.682 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:40.684 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:40.684 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:40.684 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:56:40.685 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:56:40.685 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:40.686 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:40.910 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:41.911 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:41.912 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:41.912 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:56:41.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:56:41.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:41.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:42.265 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:43.266 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:43.267 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:43.267 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:56:43.267 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:56:43.268 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:43.268 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:43.502 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:44.503 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:44.503 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:44.504 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:56:44.504 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:56:44.504 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:44.505 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:44.727 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:45.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:45.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:45.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 18 2023-01-25T04:56:45.729 INFO:tasks.workunit.client.0.smithi082.stdout:18 2023-01-25T04:56:45.729 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:45.730 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:56:45.967 INFO:tasks.workunit.client.0.smithi082.stdout:osd.0 up in weight 1 up_from 4 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/124718,v1:127.0.0.1:6801/124718] [v2:127.0.0.1:6802/124718,v1:127.0.0.1:6803/124718] exists,up 7d815480-7a63-4dfb-a13e-d7e8a813a40c 2023-01-25T04:56:45.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:56:45.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:56:45.971 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:56:45.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:171: TEST_mon_classes: run_osd td/crush-classes 1 2023-01-25T04:56:45.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:56:45.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:56:45.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2023-01-25T04:56:45.972 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:56:45.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/1 2023-01-25T04:56:45.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:56:45.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:56:45.973 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:56:45.974 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:56:45.974 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/1' 2023-01-25T04:56:45.974 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/1/journal' 2023-01-25T04:56:45.974 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:56:45.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:56:45.975 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:56:45.975 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:56:45.975 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:56:45.975 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:56:45.976 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:56:45.976 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:56:45.976 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:56:45.976 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:56:45.976 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:56:45.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:56:45.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:56:45.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:56:45.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:56:45.977 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:56:45.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:56:45.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:56:45.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:56:45.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:56:45.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:56:45.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/1 2023-01-25T04:56:45.979 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:56:45.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=11f5d588-82df-4bfb-ad7c-b10f53d8f696 2023-01-25T04:56:45.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd1 11f5d588-82df-4bfb-ad7c-b10f53d8f696' 2023-01-25T04:56:45.980 INFO:tasks.workunit.client.0.smithi082.stdout:add osd1 11f5d588-82df-4bfb-ad7c-b10f53d8f696 2023-01-25T04:56:45.980 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:56:45.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQCNttBjpSzZOhAAEFzBQCe3zYAXjuWr0EseLg== 2023-01-25T04:56:45.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQCNttBjpSzZOhAAEFzBQCe3zYAXjuWr0EseLg=="}' 2023-01-25T04:56:45.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 11f5d588-82df-4bfb-ad7c-b10f53d8f696 -i td/crush-classes/1/new.json 2023-01-25T04:56:46.388 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:56:46.399 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/1/new.json 2023-01-25T04:56:46.400 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 1 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/1 --osd-journal=td/crush-classes/1/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCNttBjpSzZOhAAEFzBQCe3zYAXjuWr0EseLg== --osd-uuid 11f5d588-82df-4bfb-ad7c-b10f53d8f696 2023-01-25T04:56:46.427 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:46.426+0000 7f13501535c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:46.429 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:46.428+0000 7f13501535c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:46.430 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:46.429+0000 7f13501535c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:46.431 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:46.430+0000 7f13501535c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:56:46.431 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:46.430+0000 7f13501535c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:56:46.431 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:46.430+0000 7f13501535c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:56:46.505 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:46.504+0000 7f13501535c0 -1 bluestore(td/crush-classes/1) _read_fsid unparsable uuid 2023-01-25T04:56:52.296 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/1/keyring 2023-01-25T04:56:52.296 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:56:52.297 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd1 key to auth repository 2023-01-25T04:56:52.298 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd1 key to auth repository 2023-01-25T04:56:52.298 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:56:52.535 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.1 2023-01-25T04:56:52.536 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.1 2023-01-25T04:56:52.537 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 1 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/1 --osd-journal=td/crush-classes/1/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:56:52.537 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:56:52.537 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:56:52.537 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:56:52.560 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:52.560+0000 7fd6671585c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:52.562 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:52.562+0000 7fd6671585c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:52.563 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:52.563+0000 7fd6671585c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:56:52.769 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 1 2023-01-25T04:56:52.770 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:56:52.770 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=1 2023-01-25T04:56:52.771 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:56:52.771 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:56:52.771 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:52.772 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:56:52.773 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:56:52.774 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:52.775 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:56:52.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:53.082 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:53.082+0000 7fd6671585c0 -1 Falling back to public interface 2023-01-25T04:56:53.980 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:53.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:53.981 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:56:53.981 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:56:53.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:53.982 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:56:54.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:55.205 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:55.205 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:55.206 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:56:55.206 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:56:55.207 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:55.207 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:56:55.426 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:55.627 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:56:55.626+0000 7fd6671585c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:56:56.427 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:56.427 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:56.428 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:56:56.428 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:56:56.428 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:56.429 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:56:56.658 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:57.659 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:57.659 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:57.660 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:56:57.660 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:56:57.661 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:57.661 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:56:57.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:56:58.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:56:58.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:56:58.891 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:56:58.891 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:56:58.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:56:58.892 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:56:59.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:00.127 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:00.127 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:00.127 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:57:00.128 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:57:00.128 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:00.128 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:00.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:01.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:01.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:01.362 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:57:01.362 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:57:01.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:01.363 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:01.595 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:02.596 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:02.596 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:02.596 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:57:02.597 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:57:02.597 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:02.597 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:02.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:03.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:03.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:03.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:57:03.822 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:57:03.823 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:03.823 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:04.058 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:05.059 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:05.059 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:05.060 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:57:05.060 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:57:05.060 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:05.061 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:05.290 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:06.291 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:06.291 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:06.291 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:57:06.292 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:57:06.292 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:06.293 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:06.514 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:07.516 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:07.516 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:07.516 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:57:07.517 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:57:07.517 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:07.518 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:07.740 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:08.741 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:08.741 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:08.741 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:57:08.742 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:57:08.742 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:08.742 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:08.967 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:09.968 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:09.968 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:09.969 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:57:09.969 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:57:09.970 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:09.970 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:10.191 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:11.193 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:11.193 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:11.193 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:57:11.194 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:57:11.194 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:11.194 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:11.416 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:12.418 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:12.418 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:12.419 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:57:12.419 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:57:12.419 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:12.420 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:12.865 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:13.866 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:13.867 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:13.867 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:57:13.868 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:57:13.868 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:13.868 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:14.096 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:15.098 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:15.098 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:15.098 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 18 2023-01-25T04:57:15.099 INFO:tasks.workunit.client.0.smithi082.stdout:18 2023-01-25T04:57:15.099 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:15.099 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:57:15.369 INFO:tasks.workunit.client.0.smithi082.stdout:osd.1 up in weight 1 up_from 8 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6808/126511,v1:127.0.0.1:6809/126511] [v2:127.0.0.1:6810/126511,v1:127.0.0.1:6811/126511] exists,up 11f5d588-82df-4bfb-ad7c-b10f53d8f696 2023-01-25T04:57:15.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:57:15.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:57:15.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:57:15.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:172: TEST_mon_classes: run_osd td/crush-classes 2 2023-01-25T04:57:15.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:57:15.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:57:15.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2023-01-25T04:57:15.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:57:15.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/2 2023-01-25T04:57:15.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:57:15.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:57:15.379 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:57:15.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:57:15.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/2' 2023-01-25T04:57:15.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/2/journal' 2023-01-25T04:57:15.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:57:15.380 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:57:15.381 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:57:15.381 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:57:15.381 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:57:15.381 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:57:15.381 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:57:15.382 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:57:15.382 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:57:15.383 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:57:15.383 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:57:15.383 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:57:15.384 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:57:15.384 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:57:15.384 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:57:15.385 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:57:15.385 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:57:15.385 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:57:15.386 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:57:15.386 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:57:15.386 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:57:15.387 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/2 2023-01-25T04:57:15.387 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:57:15.388 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=5d9f4ab4-7784-4557-8ba4-db41085480f0 2023-01-25T04:57:15.388 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd2 5d9f4ab4-7784-4557-8ba4-db41085480f0' 2023-01-25T04:57:15.389 INFO:tasks.workunit.client.0.smithi082.stdout:add osd2 5d9f4ab4-7784-4557-8ba4-db41085480f0 2023-01-25T04:57:15.389 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:57:15.391 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQCrttBjS7FAFxAApv0WsKZ8Ii+eZ+rfrvdDMw== 2023-01-25T04:57:15.391 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQCrttBjS7FAFxAApv0WsKZ8Ii+eZ+rfrvdDMw=="}' 2023-01-25T04:57:15.392 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 5d9f4ab4-7784-4557-8ba4-db41085480f0 -i td/crush-classes/2/new.json 2023-01-25T04:57:15.869 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:57:15.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/2/new.json 2023-01-25T04:57:15.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 2 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/2 --osd-journal=td/crush-classes/2/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQCrttBjS7FAFxAApv0WsKZ8Ii+eZ+rfrvdDMw== --osd-uuid 5d9f4ab4-7784-4557-8ba4-db41085480f0 2023-01-25T04:57:15.908 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:15.906+0000 7f53d6b7e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:57:15.919 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:15.917+0000 7f53d6b7e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:57:15.920 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:15.918+0000 7f53d6b7e5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:57:15.920 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:15.918+0000 7f53d6b7e5c0 -1 bluestore(td/crush-classes/2/block) _read_bdev_label failed to open td/crush-classes/2/block: (2) No such file or directory 2023-01-25T04:57:15.920 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:15.918+0000 7f53d6b7e5c0 -1 bluestore(td/crush-classes/2/block) _read_bdev_label failed to open td/crush-classes/2/block: (2) No such file or directory 2023-01-25T04:57:15.921 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:15.918+0000 7f53d6b7e5c0 -1 bluestore(td/crush-classes/2/block) _read_bdev_label failed to open td/crush-classes/2/block: (2) No such file or directory 2023-01-25T04:57:15.994 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:15.992+0000 7f53d6b7e5c0 -1 bluestore(td/crush-classes/2) _read_fsid unparsable uuid 2023-01-25T04:57:21.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/2/keyring 2023-01-25T04:57:21.373 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:57:21.374 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd2 key to auth repository 2023-01-25T04:57:21.374 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd2 key to auth repository 2023-01-25T04:57:21.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:57:21.616 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.2 2023-01-25T04:57:21.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.2 2023-01-25T04:57:21.617 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 2 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/2 --osd-journal=td/crush-classes/2/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:57:21.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:57:21.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:57:21.618 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:57:21.641 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:21.640+0000 7fc5186c95c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:57:21.644 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:21.642+0000 7fc5186c95c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:57:21.644 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:21.643+0000 7fc5186c95c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:57:21.841 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 2 2023-01-25T04:57:21.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:57:21.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=2 2023-01-25T04:57:21.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:57:21.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:57:21.842 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:21.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:57:21.843 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:57:21.843 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:21.844 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:22.062 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:22.168 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:22.167+0000 7fc5186c95c0 -1 Falling back to public interface 2023-01-25T04:57:23.063 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:23.064 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:23.064 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:57:23.065 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:57:23.065 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:23.065 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:23.290 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:24.292 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:24.293 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:24.293 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:57:24.294 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:57:24.294 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:24.295 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:24.473 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:57:24.473+0000 7fc5186c95c0 -1 osd.2 0 log_to_monitors true 2023-01-25T04:57:24.517 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:25.518 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:25.519 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:25.519 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:57:25.519 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:57:25.520 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:25.520 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:25.754 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:26.755 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:26.756 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:26.756 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:57:26.756 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:57:26.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:26.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:26.990 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:27.991 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:27.992 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:27.992 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:57:27.992 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:57:27.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:27.993 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:28.226 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:29.227 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:29.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:29.228 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:57:29.229 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:57:29.229 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:29.229 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:29.458 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:30.460 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:30.460 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:30.460 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:57:30.461 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:57:30.461 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:30.462 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:30.692 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:31.693 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:31.694 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:31.694 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:57:31.694 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:57:31.695 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:31.695 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:31.927 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:32.929 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:32.930 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:32.930 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:57:32.930 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:57:32.931 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:32.931 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:33.201 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:34.202 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:34.202 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:34.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:57:34.203 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:57:34.203 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:34.204 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:34.436 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:35.437 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:35.437 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:35.438 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:57:35.438 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:57:35.438 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:35.439 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:35.670 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:36.672 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:36.672 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:36.673 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:57:36.673 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:57:36.674 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:36.674 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:36.893 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:37.894 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:37.894 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:37.895 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:57:37.895 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:57:37.895 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:37.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:38.196 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:39.197 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:39.198 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:39.198 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:57:39.198 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:57:39.199 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:39.199 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:39.422 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:40.423 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:40.424 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:40.424 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:57:40.424 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:57:40.425 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:40.425 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:40.649 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:41.650 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:41.650 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:41.650 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:57:41.651 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:57:41.651 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:41.652 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:41.878 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:42.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:42.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:42.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:57:42.881 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:57:42.881 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:42.881 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:43.296 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:57:44.298 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:57:44.298 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:57:44.298 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 18 2023-01-25T04:57:44.299 INFO:tasks.workunit.client.0.smithi082.stdout:18 2023-01-25T04:57:44.299 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:57:44.300 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.2 up' 2023-01-25T04:57:44.568 INFO:tasks.workunit.client.0.smithi082.stdout:osd.2 up in weight 1 up_from 12 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6816/128296,v1:127.0.0.1:6817/128296] [v2:127.0.0.1:6818/128296,v1:127.0.0.1:6819/128296] exists,up 5d9f4ab4-7784-4557-8ba4-db41085480f0 2023-01-25T04:57:44.569 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:57:44.569 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:57:44.569 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:57:44.569 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:173: TEST_mon_classes: create_rbd_pool 2023-01-25T04:57:44.570 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:535: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2023-01-25T04:57:44.859 INFO:tasks.workunit.client.0.smithi082.stderr:pool 'rbd' does not exist 2023-01-25T04:57:44.869 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:536: create_rbd_pool: create_pool rbd 4 2023-01-25T04:57:44.869 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create rbd 4 2023-01-25T04:57:45.232 INFO:tasks.workunit.client.0.smithi082.stderr:pool 'rbd' already exists 2023-01-25T04:57:45.241 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2023-01-25T04:57:46.242 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: create_rbd_pool: rbd pool init rbd 2023-01-25T04:57:47.485 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:175: TEST_mon_classes: get_osds_up rbd SOMETHING 2023-01-25T04:57:47.486 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:51: get_osds_up: local poolname=rbd 2023-01-25T04:57:47.486 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:52: get_osds_up: local objectname=SOMETHING 2023-01-25T04:57:47.486 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: ceph --format xml osd map rbd SOMETHING 2023-01-25T04:57:47.487 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: xmlstarlet sel -t -m //up/osd -v . -o ' ' 2023-01-25T04:57:47.895 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:55: get_osds_up: local 'osds=1 2 0 ' 2023-01-25T04:57:47.895 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:57: get_osds_up: echo 1 2 0 2023-01-25T04:57:47.895 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:175: TEST_mon_classes: test '1 2 0' == '1 2 0' 2023-01-25T04:57:47.895 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:176: TEST_mon_classes: add_something td/crush-classes SOMETHING 2023-01-25T04:57:47.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:42: add_something: local dir=td/crush-classes 2023-01-25T04:57:47.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:43: add_something: local obj=SOMETHING 2023-01-25T04:57:47.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:45: add_something: local payload=ABCDEF 2023-01-25T04:57:47.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:46: add_something: echo ABCDEF 2023-01-25T04:57:47.896 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:47: add_something: rados --pool rbd put SOMETHING td/crush-classes/ORIGINAL 2023-01-25T04:57:48.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:179: TEST_mon_classes: ceph osd crush class create CLASS 2023-01-25T04:57:48.562 INFO:tasks.workunit.client.0.smithi082.stderr:class 'CLASS' already exists 2023-01-25T04:57:48.571 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:180: TEST_mon_classes: ceph osd crush class create CLASS 2023-01-25T04:57:48.793 INFO:tasks.workunit.client.0.smithi082.stderr:class 'CLASS' already exists 2023-01-25T04:57:48.803 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:181: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:57:48.804 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:181: TEST_mon_classes: grep CLASS 2023-01-25T04:57:49.038 INFO:tasks.workunit.client.0.smithi082.stdout: "CLASS" 2023-01-25T04:57:49.038 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:182: TEST_mon_classes: ceph osd crush class rename CLASS TEMP 2023-01-25T04:57:49.413 INFO:tasks.workunit.client.0.smithi082.stderr:already renamed to 'TEMP' 2023-01-25T04:57:49.423 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:183: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:57:49.423 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:183: TEST_mon_classes: grep TEMP 2023-01-25T04:57:49.656 INFO:tasks.workunit.client.0.smithi082.stdout: "TEMP" 2023-01-25T04:57:49.657 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:184: TEST_mon_classes: ceph osd crush class rename TEMP CLASS 2023-01-25T04:57:50.076 INFO:tasks.workunit.client.0.smithi082.stderr:already renamed to 'CLASS' 2023-01-25T04:57:50.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:185: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:57:50.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:185: TEST_mon_classes: grep CLASS 2023-01-25T04:57:50.316 INFO:tasks.workunit.client.0.smithi082.stdout: "CLASS" 2023-01-25T04:57:50.317 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:186: TEST_mon_classes: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd crush-device-class=CLASS 2023-01-25T04:57:50.734 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:187: TEST_mon_classes: expect_failure td/crush-classes EBUSY ceph osd crush class rm CLASS 2023-01-25T04:57:50.735 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1892: expect_failure: local dir=td/crush-classes 2023-01-25T04:57:50.735 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1893: expect_failure: shift 2023-01-25T04:57:50.735 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1894: expect_failure: local expected=EBUSY 2023-01-25T04:57:50.735 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1895: expect_failure: shift 2023-01-25T04:57:50.736 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1896: expect_failure: local success 2023-01-25T04:57:50.736 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1898: expect_failure: ceph osd crush class rm CLASS 2023-01-25T04:57:50.938 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1901: expect_failure: success=false 2023-01-25T04:57:50.938 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1904: expect_failure: false 2023-01-25T04:57:50.939 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1904: expect_failure: grep --quiet EBUSY td/crush-classes/out 2023-01-25T04:57:50.939 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1908: expect_failure: return 0 2023-01-25T04:57:50.939 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:188: TEST_mon_classes: ceph osd erasure-code-profile rm myprofile 2023-01-25T04:57:51.412 INFO:tasks.workunit.client.0.smithi082.stderr:erasure-code-profile myprofile does not exist 2023-01-25T04:57:51.421 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:189: TEST_mon_classes: ceph osd crush class rm CLASS 2023-01-25T04:57:51.876 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:190: TEST_mon_classes: ceph osd crush class rm CLASS 2023-01-25T04:57:52.110 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:193: TEST_mon_classes: ceph osd crush set-device-class aaa osd.0 2023-01-25T04:57:52.787 INFO:tasks.workunit.client.0.smithi082.stderr:osd.0 already set to class aaa. set-device-class item id 0 name 'osd.0' device_class 'aaa': no change. set osd(s) to class 'aaa' 2023-01-25T04:57:52.797 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:194: TEST_mon_classes: ceph osd tree 2023-01-25T04:57:52.797 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:194: TEST_mon_classes: grep -q aaa 2023-01-25T04:57:53.021 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:195: TEST_mon_classes: ceph osd crush dump 2023-01-25T04:57:53.021 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:195: TEST_mon_classes: grep -q '~aaa' 2023-01-25T04:57:53.248 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:196: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:57:53.248 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:196: TEST_mon_classes: grep -q '~aaa' 2023-01-25T04:57:53.515 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:197: TEST_mon_classes: ceph osd crush set-device-class bbb osd.1 2023-01-25T04:57:54.042 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 already set to class bbb. set-device-class item id 1 name 'osd.1' device_class 'bbb': no change. set osd(s) to class 'bbb' 2023-01-25T04:57:54.052 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:198: TEST_mon_classes: ceph osd tree 2023-01-25T04:57:54.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:198: TEST_mon_classes: grep -q bbb 2023-01-25T04:57:54.304 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:199: TEST_mon_classes: ceph osd crush dump 2023-01-25T04:57:54.304 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:199: TEST_mon_classes: grep -q '~bbb' 2023-01-25T04:57:54.577 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:200: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:57:54.578 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:200: TEST_mon_classes: grep -q '~bbb' 2023-01-25T04:57:54.832 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:201: TEST_mon_classes: ceph osd crush set-device-class ccc osd.2 2023-01-25T04:57:55.433 INFO:tasks.workunit.client.0.smithi082.stderr:osd.2 already set to class ccc. set-device-class item id 2 name 'osd.2' device_class 'ccc': no change. set osd(s) to class 'ccc' 2023-01-25T04:57:55.443 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:202: TEST_mon_classes: ceph osd tree 2023-01-25T04:57:55.443 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:202: TEST_mon_classes: grep -q ccc 2023-01-25T04:57:55.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:203: TEST_mon_classes: ceph osd crush dump 2023-01-25T04:57:55.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:203: TEST_mon_classes: grep -q '~ccc' 2023-01-25T04:57:55.997 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:204: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:57:55.998 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:204: TEST_mon_classes: grep -q '~ccc' 2023-01-25T04:57:56.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:205: TEST_mon_classes: ceph osd crush rm-device-class 0 2023-01-25T04:57:57.056 INFO:tasks.workunit.client.0.smithi082.stderr:osd.0 belongs to no class, done removing class of osd(s): 2023-01-25T04:57:57.066 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:206: TEST_mon_classes: ceph osd tree 2023-01-25T04:57:57.067 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:206: TEST_mon_classes: grep -q aaa 2023-01-25T04:57:57.324 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:207: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:57:57.324 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:207: TEST_mon_classes: grep -q aaa 2023-01-25T04:57:57.567 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:208: TEST_mon_classes: ceph osd crush rm-device-class 1 2023-01-25T04:57:58.117 INFO:tasks.workunit.client.0.smithi082.stderr:osd.1 belongs to no class, done removing class of osd(s): 2023-01-25T04:57:58.128 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:209: TEST_mon_classes: ceph osd tree 2023-01-25T04:57:58.129 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:209: TEST_mon_classes: grep -q bbb 2023-01-25T04:57:58.420 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:210: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:57:58.421 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:210: TEST_mon_classes: grep -q bbb 2023-01-25T04:57:58.677 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:211: TEST_mon_classes: ceph osd crush rm-device-class 2 2023-01-25T04:57:59.172 INFO:tasks.workunit.client.0.smithi082.stderr:osd.2 belongs to no class, done removing class of osd(s): 2023-01-25T04:57:59.182 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:212: TEST_mon_classes: ceph osd tree 2023-01-25T04:57:59.182 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:212: TEST_mon_classes: grep -q ccc 2023-01-25T04:57:59.491 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:213: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:57:59.492 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:213: TEST_mon_classes: grep -q ccc 2023-01-25T04:57:59.733 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:214: TEST_mon_classes: ceph osd crush set-device-class asdf all 2023-01-25T04:58:00.260 INFO:tasks.workunit.client.0.smithi082.stderr:osd.0 already set to class asdf. osd.1 already set to class asdf. osd.2 already set to class asdf. set osd(s) to class 'asdf' 2023-01-25T04:58:00.269 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:215: TEST_mon_classes: ceph osd tree 2023-01-25T04:58:00.270 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:215: TEST_mon_classes: grep -q asdf 2023-01-25T04:58:00.512 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:216: TEST_mon_classes: ceph osd crush dump 2023-01-25T04:58:00.512 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:216: TEST_mon_classes: grep -q '~asdf' 2023-01-25T04:58:00.777 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:217: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:58:00.778 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:217: TEST_mon_classes: grep -q '~asdf' 2023-01-25T04:58:01.030 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:218: TEST_mon_classes: ceph osd crush rule create-replicated asdf-rule default host asdf 2023-01-25T04:58:01.529 INFO:tasks.workunit.client.0.smithi082.stderr:rule asdf-rule already exists 2023-01-25T04:58:01.538 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:219: TEST_mon_classes: ceph osd crush rm-device-class all 2023-01-25T04:58:02.092 INFO:tasks.workunit.client.0.smithi082.stderr:osd.0 belongs to no class, osd.1 belongs to no class, osd.2 belongs to no class, done removing class of osd(s): 2023-01-25T04:58:02.101 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:220: TEST_mon_classes: ceph osd tree 2023-01-25T04:58:02.102 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:220: TEST_mon_classes: grep -q asdf 2023-01-25T04:58:02.369 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:221: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:58:02.370 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:221: TEST_mon_classes: grep -q asdf 2023-01-25T04:58:02.642 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:223: TEST_mon_classes: ceph osd crush set-device-class abc osd.2 2023-01-25T04:58:03.129 INFO:tasks.workunit.client.0.smithi082.stderr:osd.2 already set to class abc. set-device-class item id 2 name 'osd.2' device_class 'abc': no change. set osd(s) to class 'abc' 2023-01-25T04:58:03.138 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:224: TEST_mon_classes: ceph osd crush move osd.2 root=foo rack=foo-rack host=foo-host 2023-01-25T04:58:03.581 INFO:tasks.workunit.client.0.smithi082.stderr:no need to move item id 2 name 'osd.2' to location {host=foo-host,rack=foo-rack,root=foo} in crush map 2023-01-25T04:58:03.591 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:225: TEST_mon_classes: ceph osd tree 2023-01-25T04:58:03.591 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:225: TEST_mon_classes: awk '$1 == 2 && $2 == "abc" {print $0}' 2023-01-25T04:58:03.848 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:225: TEST_mon_classes: out=' 2 abc 0.09769 osd.2 up 1.00000 1.00000' 2023-01-25T04:58:03.849 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:226: TEST_mon_classes: '[' ' 2 abc 0.09769 osd.2 up 1.00000 1.00000' == '' ']' 2023-01-25T04:58:03.849 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:231: TEST_mon_classes: ceph osd crush dump 2023-01-25T04:58:03.850 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:231: TEST_mon_classes: grep -q foo~abc 2023-01-25T04:58:04.114 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:232: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:58:04.115 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:232: TEST_mon_classes: grep -q foo~abc 2023-01-25T04:58:04.437 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:233: TEST_mon_classes: ceph osd crush dump 2023-01-25T04:58:04.437 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:233: TEST_mon_classes: grep -q foo-rack~abc 2023-01-25T04:58:04.754 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:234: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:58:04.754 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:234: TEST_mon_classes: grep -q foo-rack~abc 2023-01-25T04:58:05.100 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:235: TEST_mon_classes: ceph osd crush dump 2023-01-25T04:58:05.100 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:235: TEST_mon_classes: grep -q foo-host~abc 2023-01-25T04:58:05.351 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:236: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:58:05.352 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:236: TEST_mon_classes: grep -q foo-host~abc 2023-01-25T04:58:05.651 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:237: TEST_mon_classes: ceph osd crush rm-device-class osd.2 2023-01-25T04:58:06.127 INFO:tasks.workunit.client.0.smithi082.stderr:osd.2 belongs to no class, done removing class of osd(s): 2023-01-25T04:58:06.136 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:239: TEST_mon_classes: ceph osd crush set-device-class abc osd.2 2023-01-25T04:58:06.705 INFO:tasks.workunit.client.0.smithi082.stderr:osd.2 already set to class abc. set-device-class item id 2 name 'osd.2' device_class 'abc': no change. set osd(s) to class 'abc' 2023-01-25T04:58:06.715 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:241: TEST_mon_classes: ceph osd crush rule create-replicated foo-rule foo host abc 2023-01-25T04:58:07.308 INFO:tasks.workunit.client.0.smithi082.stderr:rule foo-rule already exists 2023-01-25T04:58:07.318 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:244: TEST_mon_classes: ceph osd crush set-device-class hdd osd.0 2023-01-25T04:58:07.869 INFO:tasks.workunit.client.0.smithi082.stderr:osd.0 already set to class hdd. set-device-class item id 0 name 'osd.0' device_class 'hdd': no change. set osd(s) to class 'hdd' 2023-01-25T04:58:07.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:245: TEST_mon_classes: expect_failure td/crush-classes EBUSY ceph osd crush set-device-class nvme osd.0 2023-01-25T04:58:07.880 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1892: expect_failure: local dir=td/crush-classes 2023-01-25T04:58:07.881 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1893: expect_failure: shift 2023-01-25T04:58:07.881 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1894: expect_failure: local expected=EBUSY 2023-01-25T04:58:07.882 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1895: expect_failure: shift 2023-01-25T04:58:07.882 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1896: expect_failure: local success 2023-01-25T04:58:07.882 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1898: expect_failure: ceph osd crush set-device-class nvme osd.0 2023-01-25T04:58:08.052 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1901: expect_failure: success=false 2023-01-25T04:58:08.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1904: expect_failure: false 2023-01-25T04:58:08.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1904: expect_failure: grep --quiet EBUSY td/crush-classes/out 2023-01-25T04:58:08.054 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1908: expect_failure: return 0 2023-01-25T04:58:08.054 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:248: TEST_mon_classes: ceph osd crush rm-device-class all 2023-01-25T04:58:08.739 INFO:tasks.workunit.client.0.smithi082.stderr:osd.0 belongs to no class, osd.1 belongs to no class, osd.2 belongs to no class, done removing class of osd(s): 2023-01-25T04:58:08.749 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:249: TEST_mon_classes: ceph osd crush set-device-class class_1 all 2023-01-25T04:58:09.350 INFO:tasks.workunit.client.0.smithi082.stderr:osd.0 already set to class class_1. osd.1 already set to class class_1. osd.2 already set to class class_1. set osd(s) to class 'class_1' 2023-01-25T04:58:09.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:250: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:58:09.361 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:250: TEST_mon_classes: grep class_1 2023-01-25T04:58:09.619 INFO:tasks.workunit.client.0.smithi082.stdout: "class_1" 2023-01-25T04:58:09.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:251: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:58:09.620 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:251: TEST_mon_classes: grep class_1 2023-01-25T04:58:09.927 INFO:tasks.workunit.client.0.smithi082.stdout:-20 class_1 0.19537 root default~class_1 2023-01-25T04:58:09.928 INFO:tasks.workunit.client.0.smithi082.stdout:-19 class_1 0.19537 host smithi082~class_1 2023-01-25T04:58:09.928 INFO:tasks.workunit.client.0.smithi082.stdout: 0 class_1 0.09769 osd.0 2023-01-25T04:58:09.928 INFO:tasks.workunit.client.0.smithi082.stdout: 1 class_1 0.09769 osd.1 2023-01-25T04:58:09.929 INFO:tasks.workunit.client.0.smithi082.stdout:-18 class_1 0.09769 root foo~class_1 2023-01-25T04:58:09.929 INFO:tasks.workunit.client.0.smithi082.stdout:-17 class_1 0.09769 rack foo-rack~class_1 2023-01-25T04:58:09.929 INFO:tasks.workunit.client.0.smithi082.stdout:-16 class_1 0.09769 host foo-host~class_1 2023-01-25T04:58:09.929 INFO:tasks.workunit.client.0.smithi082.stdout: 2 class_1 0.09769 osd.2 2023-01-25T04:58:09.929 INFO:tasks.workunit.client.0.smithi082.stdout: 2 class_1 0.09769 osd.2 2023-01-25T04:58:09.930 INFO:tasks.workunit.client.0.smithi082.stdout: 0 class_1 0.09769 osd.0 2023-01-25T04:58:09.930 INFO:tasks.workunit.client.0.smithi082.stdout: 1 class_1 0.09769 osd.1 2023-01-25T04:58:09.930 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:252: TEST_mon_classes: ceph osd crush rule create-replicated class_1_rule default host class_1 2023-01-25T04:58:10.393 INFO:tasks.workunit.client.0.smithi082.stderr:rule class_1_rule already exists 2023-01-25T04:58:10.403 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:253: TEST_mon_classes: ceph osd crush class rename class_1 class_2 2023-01-25T04:58:10.754 INFO:tasks.workunit.client.0.smithi082.stderr:already renamed to 'class_2' 2023-01-25T04:58:10.763 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:254: TEST_mon_classes: ceph osd crush class rename class_1 class_2 2023-01-25T04:58:11.030 INFO:tasks.workunit.client.0.smithi082.stderr:already renamed to 'class_2' 2023-01-25T04:58:11.040 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:255: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:58:11.041 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:255: TEST_mon_classes: grep class_1 2023-01-25T04:58:11.309 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:256: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:58:11.309 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:256: TEST_mon_classes: grep class_1 2023-01-25T04:58:11.568 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:257: TEST_mon_classes: ceph osd crush class ls 2023-01-25T04:58:11.568 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:257: TEST_mon_classes: grep class_2 2023-01-25T04:58:11.810 INFO:tasks.workunit.client.0.smithi082.stdout: "class_2" 2023-01-25T04:58:11.811 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:258: TEST_mon_classes: ceph osd crush tree --show-shadow 2023-01-25T04:58:11.811 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:258: TEST_mon_classes: grep class_2 2023-01-25T04:58:12.127 INFO:tasks.workunit.client.0.smithi082.stdout:-20 class_2 0.19537 root default~class_2 2023-01-25T04:58:12.127 INFO:tasks.workunit.client.0.smithi082.stdout:-19 class_2 0.19537 host smithi082~class_2 2023-01-25T04:58:12.127 INFO:tasks.workunit.client.0.smithi082.stdout: 0 class_2 0.09769 osd.0 2023-01-25T04:58:12.127 INFO:tasks.workunit.client.0.smithi082.stdout: 1 class_2 0.09769 osd.1 2023-01-25T04:58:12.128 INFO:tasks.workunit.client.0.smithi082.stdout:-18 class_2 0.09769 root foo~class_2 2023-01-25T04:58:12.128 INFO:tasks.workunit.client.0.smithi082.stdout:-17 class_2 0.09769 rack foo-rack~class_2 2023-01-25T04:58:12.128 INFO:tasks.workunit.client.0.smithi082.stdout:-16 class_2 0.09769 host foo-host~class_2 2023-01-25T04:58:12.128 INFO:tasks.workunit.client.0.smithi082.stdout: 2 class_2 0.09769 osd.2 2023-01-25T04:58:12.128 INFO:tasks.workunit.client.0.smithi082.stdout: 2 class_2 0.09769 osd.2 2023-01-25T04:58:12.129 INFO:tasks.workunit.client.0.smithi082.stdout: 0 class_2 0.09769 osd.0 2023-01-25T04:58:12.129 INFO:tasks.workunit.client.0.smithi082.stdout: 1 class_2 0.09769 osd.1 2023-01-25T04:58:12.130 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:37: run: teardown td/crush-classes 2023-01-25T04:58:12.130 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-classes 2023-01-25T04:58:12.130 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:58:12.130 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-classes KILL 2023-01-25T04:58:12.131 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:58:12.131 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:58:12.131 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:58:12.131 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:58:12.131 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:58:12.234 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:58:12.235 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:58:12.235 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:58:12.235 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:58:12.236 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:58:12.236 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:58:12.237 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:58:12.238 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:58:12.238 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:58:12.239 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:58:12.239 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:58:12.239 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:58:12.240 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:58:12.240 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-classes 2023-01-25T04:58:12.253 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:58:12.253 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:12.253 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:12.253 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.118012 2023-01-25T04:58:12.255 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:58:12.255 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:58:12.255 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:34: run: for func in $funcs 2023-01-25T04:58:12.255 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:35: run: setup td/crush-classes 2023-01-25T04:58:12.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/crush-classes 2023-01-25T04:58:12.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/crush-classes 2023-01-25T04:58:12.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/crush-classes 2023-01-25T04:58:12.256 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2023-01-25T04:58:12.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/crush-classes KILL 2023-01-25T04:58:12.257 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2023-01-25T04:58:12.257 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2023-01-25T04:58:12.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2023-01-25T04:58:12.257 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2023-01-25T04:58:12.258 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2023-01-25T04:58:12.259 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2023-01-25T04:58:12.259 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2023-01-25T04:58:12.259 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2023-01-25T04:58:12.259 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2023-01-25T04:58:12.260 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2023-01-25T04:58:12.260 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2023-01-25T04:58:12.260 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2023-01-25T04:58:12.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:58:12.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2023-01-25T04:58:12.261 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2023-01-25T04:58:12.262 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:58:12.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2023-01-25T04:58:12.263 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2023-01-25T04:58:12.263 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/crush-classes 2023-01-25T04:58:12.264 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2023-01-25T04:58:12.264 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:12.264 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:12.264 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.118012 2023-01-25T04:58:12.265 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2023-01-25T04:58:12.266 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2023-01-25T04:58:12.266 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/crush-classes 2023-01-25T04:58:12.266 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2023-01-25T04:58:12.266 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:12.267 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:12.267 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.118012 2023-01-25T04:58:12.268 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2023-01-25T04:58:12.269 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2023-01-25T04:58:12.269 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2023-01-25T04:58:12.269 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/crush-classes 1' TERM HUP INT 2023-01-25T04:58:12.269 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:36: run: TEST_reweight_vs_classes td/crush-classes 2023-01-25T04:58:12.269 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:61: TEST_reweight_vs_classes: local dir=td/crush-classes 2023-01-25T04:58:12.270 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:66: TEST_reweight_vs_classes: run_mon td/crush-classes a 2023-01-25T04:58:12.270 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/crush-classes 2023-01-25T04:58:12.270 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2023-01-25T04:58:12.270 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2023-01-25T04:58:12.271 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2023-01-25T04:58:12.271 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/crush-classes/a 2023-01-25T04:58:12.271 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/crush-classes/a --run-dir=td/crush-classes 2023-01-25T04:58:12.624 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2023-01-25T04:58:12.625 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:58:12.625 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:58:12.625 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:58:12.626 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:12.626 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:12.626 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:58:12.626 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/crush-classes/a '--log-file=td/crush-classes/$name.log' '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --mon-cluster-log-file=td/crush-classes/log --run-dir=td/crush-classes '--pid-file=td/crush-classes/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2023-01-25T04:58:12.875 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2023-01-25T04:58:12.876 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2023-01-25T04:58:12.877 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:58:12.877 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:58:12.877 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=fsid 2023-01-25T04:58:12.877 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .fsid 2023-01-25T04:58:12.879 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:58:12.879 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:58:12.879 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:58:12.879 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:58:12.879 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:12.880 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:12.880 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.118012/ceph-mon.a.asok 2023-01-25T04:58:12.880 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:58:12.880 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.118012/ceph-mon.a.asok config get fsid 2023-01-25T04:58:12.980 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2023-01-25T04:58:12.980 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: local daemon=mon 2023-01-25T04:58:12.981 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1124: get_config: local id=a 2023-01-25T04:58:12.981 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local config=mon_host 2023-01-25T04:58:12.981 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1130: get_config: jq -r .mon_host 2023-01-25T04:58:12.981 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: get_asok_path mon.a 2023-01-25T04:58:12.981 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2023-01-25T04:58:12.982 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2023-01-25T04:58:12.982 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2023-01-25T04:58:12.982 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:12.982 INFO:tasks.workunit.client.0.smithi082.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:12.982 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.118012/ceph-mon.a.asok 2023-01-25T04:58:12.983 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: CEPH_ARGS= 2023-01-25T04:58:12.983 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: ceph --format json daemon /tmp/ceph-asok.118012/ceph-mon.a.asok config get mon_host 2023-01-25T04:58:13.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:67: TEST_reweight_vs_classes: run_osd td/crush-classes 0 2023-01-25T04:58:13.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:58:13.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:58:13.084 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2023-01-25T04:58:13.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:58:13.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/0 2023-01-25T04:58:13.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:58:13.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:58:13.085 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:58:13.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:58:13.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/0' 2023-01-25T04:58:13.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/0/journal' 2023-01-25T04:58:13.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:58:13.086 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:58:13.087 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:58:13.087 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:58:13.087 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:58:13.087 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:58:13.088 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:58:13.088 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:13.088 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:13.088 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:58:13.088 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:58:13.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:58:13.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:58:13.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:58:13.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:58:13.089 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:58:13.090 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:58:13.090 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:58:13.090 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:58:13.090 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:58:13.090 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:58:13.091 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/0 2023-01-25T04:58:13.091 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:58:13.091 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=b141343a-6936-4fad-93f3-ee2fec9a2a64 2023-01-25T04:58:13.091 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd0 b141343a-6936-4fad-93f3-ee2fec9a2a64' 2023-01-25T04:58:13.092 INFO:tasks.workunit.client.0.smithi082.stdout:add osd0 b141343a-6936-4fad-93f3-ee2fec9a2a64 2023-01-25T04:58:13.092 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:58:13.102 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQDlttBj9NgGBhAAWoYxdfvc8I9RKCkxa/W7Lw== 2023-01-25T04:58:13.102 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQDlttBj9NgGBhAAWoYxdfvc8I9RKCkxa/W7Lw=="}' 2023-01-25T04:58:13.103 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new b141343a-6936-4fad-93f3-ee2fec9a2a64 -i td/crush-classes/0/new.json 2023-01-25T04:58:14.058 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:58:14.069 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/0/new.json 2023-01-25T04:58:14.070 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 0 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/0 --osd-journal=td/crush-classes/0/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQDlttBj9NgGBhAAWoYxdfvc8I9RKCkxa/W7Lw== --osd-uuid b141343a-6936-4fad-93f3-ee2fec9a2a64 2023-01-25T04:58:14.097 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:14.097+0000 7fe3066fc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:14.099 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:14.098+0000 7fe3066fc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:14.100 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:14.098+0000 7fe3066fc5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:14.101 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:14.099+0000 7fe3066fc5c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:58:14.101 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:14.099+0000 7fe3066fc5c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:58:14.102 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:14.099+0000 7fe3066fc5c0 -1 bluestore(td/crush-classes/0/block) _read_bdev_label failed to open td/crush-classes/0/block: (2) No such file or directory 2023-01-25T04:58:14.150 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:14.149+0000 7fe3066fc5c0 -1 bluestore(td/crush-classes/0) _read_fsid unparsable uuid 2023-01-25T04:58:19.485 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/0/keyring 2023-01-25T04:58:19.485 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:58:19.486 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd0 key to auth repository 2023-01-25T04:58:19.486 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd0 key to auth repository 2023-01-25T04:58:19.487 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:58:19.726 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.0 2023-01-25T04:58:19.727 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.0 2023-01-25T04:58:19.727 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:58:19.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 0 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/0 --osd-journal=td/crush-classes/0/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:58:19.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:58:19.728 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:58:19.752 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:19.751+0000 7fa059a605c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:19.754 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:19.753+0000 7fa059a605c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:19.755 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:19.754+0000 7fa059a605c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:19.953 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 0 2023-01-25T04:58:19.953 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:58:19.954 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=0 2023-01-25T04:58:19.954 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:58:19.955 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:58:19.955 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:19.955 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:58:19.956 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:58:19.956 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:19.956 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:20.176 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:20.285 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:20.285+0000 7fa059a605c0 -1 Falling back to public interface 2023-01-25T04:58:21.178 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:21.178 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:21.178 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:58:21.179 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:58:21.179 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:21.179 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:21.412 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:22.414 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:22.414 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:22.415 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:58:22.416 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:58:22.416 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:22.417 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:22.636 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:22.635+0000 7fa059a605c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:58:22.650 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:23.652 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:23.652 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:23.652 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:58:23.653 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:58:23.653 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:23.654 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:23.887 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:24.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:24.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:24.888 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:58:24.889 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:58:24.889 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:24.890 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:25.122 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:26.123 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:26.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:26.124 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:58:26.124 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:58:26.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:26.125 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:26.354 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:27.355 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:27.355 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:27.356 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:58:27.356 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:58:27.356 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:27.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:27.581 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:28.582 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:28.583 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:28.583 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:58:28.584 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:58:28.584 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:28.584 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:28.818 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:29.819 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:29.819 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:29.820 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:58:29.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:58:29.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:29.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:30.053 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:31.054 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:31.055 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:31.055 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:58:31.056 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:58:31.056 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:31.056 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:31.288 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:32.289 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:32.290 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:32.290 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:58:32.291 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:58:32.291 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:32.291 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:32.520 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:33.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:33.522 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:33.523 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:58:33.524 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:58:33.525 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:33.525 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:33.758 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:34.759 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:34.759 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:34.760 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:58:34.760 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:58:34.761 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:34.761 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:34.985 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:35.986 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:35.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:35.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:58:35.987 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:58:35.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:35.988 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:36.214 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:37.216 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:37.216 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:37.216 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:58:37.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:58:37.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:37.217 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:37.447 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:38.448 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:38.449 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:38.449 INFO:tasks.workunit.client.0.smithi082.stdout:15 2023-01-25T04:58:38.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 15 2023-01-25T04:58:38.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:38.450 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:38.677 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:39.679 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:39.679 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:39.679 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 16 2023-01-25T04:58:39.680 INFO:tasks.workunit.client.0.smithi082.stdout:16 2023-01-25T04:58:39.680 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:39.680 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:39.910 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:40.911 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:40.911 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:40.912 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 17 2023-01-25T04:58:40.912 INFO:tasks.workunit.client.0.smithi082.stdout:17 2023-01-25T04:58:40.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:40.913 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:41.143 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:42.145 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:42.145 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:42.145 INFO:tasks.workunit.client.0.smithi082.stdout:18 2023-01-25T04:58:42.146 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 18 2023-01-25T04:58:42.146 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:42.146 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:42.375 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:43.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:43.376 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:43.377 INFO:tasks.workunit.client.0.smithi082.stdout:19 2023-01-25T04:58:43.377 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 19 2023-01-25T04:58:43.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:43.378 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.0 up' 2023-01-25T04:58:43.601 INFO:tasks.workunit.client.0.smithi082.stdout:osd.0 up in weight 1 up_from 4 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/131950,v1:127.0.0.1:6801/131950] [v2:127.0.0.1:6802/131950,v1:127.0.0.1:6803/131950] exists,up b141343a-6936-4fad-93f3-ee2fec9a2a64 2023-01-25T04:58:43.606 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: status=0 2023-01-25T04:58:43.606 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:986: wait_for_osd: break 2023-01-25T04:58:43.606 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:989: wait_for_osd: return 0 2023-01-25T04:58:43.606 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh:68: TEST_reweight_vs_classes: run_osd td/crush-classes 1 2023-01-25T04:58:43.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/crush-classes 2023-01-25T04:58:43.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2023-01-25T04:58:43.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2023-01-25T04:58:43.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2023-01-25T04:58:43.607 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/crush-classes/1 2023-01-25T04:58:43.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false ' 2023-01-25T04:58:43.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2023-01-25T04:58:43.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2023-01-25T04:58:43.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2023-01-25T04:58:43.608 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/crush-classes/1' 2023-01-25T04:58:43.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/crush-classes/1/journal' 2023-01-25T04:58:43.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2023-01-25T04:58:43.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2023-01-25T04:58:43.609 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/crush-classes' 2023-01-25T04:58:43.609 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2023-01-25T04:58:43.610 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2023-01-25T04:58:43.610 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2023-01-25T04:58:43.610 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2023-01-25T04:58:43.610 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2023-01-25T04:58:43.610 INFO:tasks.workunit.client.0.smithi082.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.118012 2023-01-25T04:58:43.611 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:58:43.611 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' 2023-01-25T04:58:43.611 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2023-01-25T04:58:43.611 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2023-01-25T04:58:43.611 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2023-01-25T04:58:43.612 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/crush-classes/$name.log' 2023-01-25T04:58:43.612 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/crush-classes/$name.pid' 2023-01-25T04:58:43.612 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2023-01-25T04:58:43.612 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2023-01-25T04:58:43.612 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:58:43.613 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' ' 2023-01-25T04:58:43.613 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+= 2023-01-25T04:58:43.613 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: mkdir -p td/crush-classes/1 2023-01-25T04:58:43.613 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: uuidgen 2023-01-25T04:58:43.614 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local uuid=5b7da0d3-faf2-491d-93a1-786874b96fd3 2023-01-25T04:58:43.614 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: echo 'add osd1 5b7da0d3-faf2-491d-93a1-786874b96fd3' 2023-01-25T04:58:43.614 INFO:tasks.workunit.client.0.smithi082.stdout:add osd1 5b7da0d3-faf2-491d-93a1-786874b96fd3 2023-01-25T04:58:43.614 INFO:tasks.workunit.client.0.smithi082.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: ceph-authtool --gen-print-key 2023-01-25T04:58:43.623 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: OSD_SECRET=AQADt9Bjhj4RJRAAI68OOhO/Q3d6vjEAAgDA1A== 2023-01-25T04:58:43.623 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: echo '{"cephx_secret": "AQADt9Bjhj4RJRAAI68OOhO/Q3d6vjEAAgDA1A=="}' 2023-01-25T04:58:43.623 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: ceph osd new 5b7da0d3-faf2-491d-93a1-786874b96fd3 -i td/crush-classes/1/new.json 2023-01-25T04:58:43.967 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:58:43.978 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: rm td/crush-classes/1/new.json 2023-01-25T04:58:43.979 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph-osd -i 1 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/1 --osd-journal=td/crush-classes/1/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --mkfs --key AQADt9Bjhj4RJRAAI68OOhO/Q3d6vjEAAgDA1A== --osd-uuid 5b7da0d3-faf2-491d-93a1-786874b96fd3 2023-01-25T04:58:44.006 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:44.004+0000 7f8d4e3555c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:44.043 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:44.041+0000 7f8d4e3555c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:44.044 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:44.042+0000 7f8d4e3555c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:44.044 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:44.042+0000 7f8d4e3555c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:58:44.045 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:44.042+0000 7f8d4e3555c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:58:44.045 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:44.042+0000 7f8d4e3555c0 -1 bluestore(td/crush-classes/1/block) _read_bdev_label failed to open td/crush-classes/1/block: (2) No such file or directory 2023-01-25T04:58:44.083 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:44.082+0000 7f8d4e3555c0 -1 bluestore(td/crush-classes/1) _read_fsid unparsable uuid 2023-01-25T04:58:49.436 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: local key_fn=td/crush-classes/1/keyring 2023-01-25T04:58:49.436 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: cat 2023-01-25T04:58:49.437 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:674: run_osd: echo adding osd1 key to auth repository 2023-01-25T04:58:49.437 INFO:tasks.workunit.client.0.smithi082.stdout:adding osd1 key to auth repository 2023-01-25T04:58:49.438 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: ceph -i td/crush-classes/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2023-01-25T04:58:49.680 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: echo start osd.1 2023-01-25T04:58:49.681 INFO:tasks.workunit.client.0.smithi082.stdout:start osd.1 2023-01-25T04:58:49.682 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: ceph-osd -i 1 --fsid=fcda1a2b-df5f-4840-b042-573ea45839ec --auth-supported=none --mon-host=127.0.0.1:7130 --osd-class-update-on-start=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/crush-classes/1 --osd-journal=td/crush-classes/1/journal --chdir= --run-dir=td/crush-classes '--admin-socket=/tmp/ceph-asok.118012/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/crush-classes/$name.log' '--pid-file=td/crush-classes/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' 2023-01-25T04:58:49.682 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: ceph osd dump --format=json 2023-01-25T04:58:49.682 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: jq '.flags_set[]' 2023-01-25T04:58:49.682 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:680: run_osd: grep -q '"noup"' 2023-01-25T04:58:49.706 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:49.704+0000 7f66b3ebd5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:49.707 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:49.706+0000 7f66b3ebd5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:49.708 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:49.707+0000 7f66b3ebd5c0 -1 WARNING: all dangerous and experimental features are enabled. 2023-01-25T04:58:49.906 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:683: run_osd: wait_for_osd up 1 2023-01-25T04:58:49.906 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: local state=up 2023-01-25T04:58:49.906 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:977: wait_for_osd: local id=1 2023-01-25T04:58:49.906 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: status=1 2023-01-25T04:58:49.907 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i=0 )) 2023-01-25T04:58:49.907 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:49.907 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 0 2023-01-25T04:58:49.907 INFO:tasks.workunit.client.0.smithi082.stdout:0 2023-01-25T04:58:49.908 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:49.908 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:50.130 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:50.231 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:50.230+0000 7f66b3ebd5c0 -1 Falling back to public interface 2023-01-25T04:58:51.131 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:51.132 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:51.132 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 1 2023-01-25T04:58:51.132 INFO:tasks.workunit.client.0.smithi082.stdout:1 2023-01-25T04:58:51.133 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:51.133 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:51.357 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:52.358 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:52.359 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:52.359 INFO:tasks.workunit.client.0.smithi082.stdout:2 2023-01-25T04:58:52.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 2 2023-01-25T04:58:52.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:52.360 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:52.522 INFO:tasks.workunit.client.0.smithi082.stderr:2023-01-25T04:58:52.520+0000 7f66b3ebd5c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:58:52.585 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:53.586 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:53.587 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:53.587 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 3 2023-01-25T04:58:53.587 INFO:tasks.workunit.client.0.smithi082.stdout:3 2023-01-25T04:58:53.588 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:53.588 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:53.820 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:54.821 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:54.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:54.822 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 4 2023-01-25T04:58:54.822 INFO:tasks.workunit.client.0.smithi082.stdout:4 2023-01-25T04:58:54.823 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:54.823 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:55.057 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:56.058 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:56.059 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:56.059 INFO:tasks.workunit.client.0.smithi082.stdout:5 2023-01-25T04:58:56.060 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 5 2023-01-25T04:58:56.060 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:56.060 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:56.285 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:57.287 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:57.287 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:57.287 INFO:tasks.workunit.client.0.smithi082.stdout:6 2023-01-25T04:58:57.288 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 6 2023-01-25T04:58:57.288 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:57.288 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:57.517 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:58.518 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:58.519 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:58.519 INFO:tasks.workunit.client.0.smithi082.stdout:7 2023-01-25T04:58:58.520 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 7 2023-01-25T04:58:58.520 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:58.520 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:58.754 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:58:59.756 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:58:59.756 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:58:59.756 INFO:tasks.workunit.client.0.smithi082.stdout:8 2023-01-25T04:58:59.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 8 2023-01-25T04:58:59.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:58:59.757 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:58:59.987 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:59:00.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:59:00.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:59:00.989 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 9 2023-01-25T04:59:00.990 INFO:tasks.workunit.client.0.smithi082.stdout:9 2023-01-25T04:59:00.990 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:59:00.990 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:59:01.222 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:59:02.223 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:59:02.223 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:59:02.223 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 10 2023-01-25T04:59:02.224 INFO:tasks.workunit.client.0.smithi082.stdout:10 2023-01-25T04:59:02.224 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:59:02.225 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:59:02.452 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:59:03.453 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:59:03.454 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:59:03.454 INFO:tasks.workunit.client.0.smithi082.stdout:11 2023-01-25T04:59:03.455 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 11 2023-01-25T04:59:03.455 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:59:03.455 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:59:03.802 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:59:04.803 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:59:04.804 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:59:04.804 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 12 2023-01-25T04:59:04.804 INFO:tasks.workunit.client.0.smithi082.stdout:12 2023-01-25T04:59:04.805 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:59:04.805 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:59:05.035 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:59:06.036 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:59:06.037 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:59:06.037 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 13 2023-01-25T04:59:06.037 INFO:tasks.workunit.client.0.smithi082.stdout:13 2023-01-25T04:59:06.038 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:59:06.038 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:59:06.262 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:59:07.263 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:59:07.264 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i < 300 )) 2023-01-25T04:59:07.264 INFO:tasks.workunit.client.0.smithi082.stdout:14 2023-01-25T04:59:07.265 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: echo 14 2023-01-25T04:59:07.265 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: ceph osd dump 2023-01-25T04:59:07.265 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: grep 'osd.1 up' 2023-01-25T04:59:07.498 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: sleep 1 2023-01-25T04:59:08.499 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:980: wait_for_osd: (( i++ )) 2023-01-25T04:59:08.500 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clo